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Effect of Hard Limiting on the Probabilities of Incorrect 
Dismissal and False Alarm at the Output of : 
an Envelope Detector* 


P. BELLO, ASSocIATE MEMBER, IRE, 


Summary—This paper is concerned with the effect of hard 
limiting on the signal detectability of a system consisting of a 
limiter, narrow-band filter, and envelope detector in cascade. The 
input to the system is a pulsed IF signal immersed in noise whose 
power spectrum is uniform over a band of width W cycles. 

Assuming that the noise bandwidth W is much larger than the 
bandwidth of the narrow-band filter, the probability distribution 
of the output of the filter will approach Gaussian. A bivariate 
Edgeworth series approximation is necessary to handle the narrow- 
band-filter output since the ‘‘in-phase’’? and ‘‘quadrature’’? com- 
ponents of the narrow-band-filter output are statistically dependent 
random variables. An expression is derived for the probability 
of incorrect dismissal that requires the numerical evaluation of 
single integrals only. From the same bivariate Edgeworth series, 
an expression is derived for the probability-density function of the 
output of the envelope detector for the zero-input-signal case. 
Subsequent integration leads to the probability of false alarm. 


INTRODUCTION 


N the attempt to achieve a constant-false-alarm-rate 
(CFAR) capability, a limiter is frequently used 
before signal filtering and detection in a_ radar 

system. The effect of the limiter on the probabilities of 
false alarm and incorrect dismissal is of interest. This 
paper’ is concerned with the system of Fig. 1, which 
shows a limiter followed by a narrow-band filter, envelope 
detector, and threshold device in cascade. The input to 
the limiter consists of stationary Gaussian noise plus an 
IF pulse train. The output of the envelope detector is a 
train of video pulses perturbed nonlinearly by noise. 


| ENVELOPE [R (t) 


DETECTOR ae 


Fig. 1—System to be analyzed. 


The following expressions for signal and noise, re- 
spectively, apply at the input to the limiter: 
s(t) = P(t) COS Wot 
n(t) = x(t) CoS wot — y(t) SiN wol. (1) 


This expression for s(t) presumes a coherent set of pulses. 


* Received by the PGIT, October 19, 1959; revised manuscript 
received November 16, 1960. 

+ Sylvania Electric Products, Inc., Sylvania Electronic Systems 
Div., Appl. Res. Lab., Waltham, Mass. 

t Lincoln Lab., Mass. Inst. Tech., Lexington, Mass. 

1 For a more detailed discussion of the method of approach 
used in this paper, the reader is referred to P. Bello and W. Higgins, 

“Effect. of Limiting on the Probability of Incorrect Dismissal at 

the Output of an Envelope Detector,’ Appl. Res. Memo. 163, 
Appl. Res. Lab., Sylvania Electric Products, Inc., Waltham, Mass.; 
March, 1959. 
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Since the output statistics of the envelope detector are 
functionally independent of the initial phase of the set oj 
input pulses; and since it will be assumed henceforth that 
the narrowband filter ‘integrates’ over only one pulse, the 
assumption of coherence will not matter. The input to the 
limiter, 2(¢), is given by 


z(t) 


[x(t) + P(£)] cos a ot — y(2) sin wot | 


R(t) cos [wot + oY], (2 


where F(t) is the envelope and ¢(¢) is the phase of 2(t). 
It is assumed that n(t) is a narrowband noise of band, 
width W centered on w) radians per second. The bandpas 
limiter is assumed to be ideal in the sense that its outpu, 

L(t) is given by 
L(t) = cos [wot + $()]; 3 


v.e., envelope variations have been completely removed 
L(t) may be expressed in the form 
L(t) = X(t) coswot — Y(t) sin aol, (4 


where X(t) and Y(t), the amplitudes of the “ 
and ‘“‘quadrature”’ 


in-phase’ 
components, are given by, 


aC eG x(t) + P(t) 
(1) = cos g(t) ViE@ FPO EVO’ 
Y(t) = sin g(t) = y(t) 


V [e(t) + POP + 


The output of the narrow-band filter, I(d), may b 
expressed as 


KGS) = 


where X,(¢) and Y,(t) are the amplitudes of the “in- -phase 
and “quadrature” components of I(t). 
If the narrow-band filter is symmetrical about it 


center frequency wo, its impulse response may be ex 
pressed in the form 


h(t) 


It may readily be shown that X,(t) and Y,(t) are the 
given (apart from an irrelevant constant multiplier) b 
I 


X(t) = E(t) ® X(t) (6 
Y(t) = El) @ yn} | 


X(t) cos wot — Y,(t) sin wol, (é 


= H(t) Cos wot. (7 
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sre the operation ®) is convolution. The output 
elope from an ideal envelope detector is then 


Kae) ee (9) 


“he problem has been converted from a narrow-band 
lation to an equivalent low-frequency one concerning 
y the amplitudes of the in-phase and quadrature com- 
ents X, Y at the output of the limiter, and an equiv- 
nt low-pass filter whose impulse response is equal to 
envelope of the impulse response of the narrow-band 
or, E(t). 

‘or convenience we adjust the pulse train so that a 
eo pulse has its maximum at ¢ = 0 (in the absence of 
se). Then the quantity that we wish to calculate is the 
bability that the envelope lies below a_ specified 
eshold at ¢ = 0.” 

‘or t = 0, (8) implies 


th E()X(—1 dt = (10) 


/ E()Y(—8 dt = (11) 
0 

ere U and V denote the amplitudes of thex‘‘in-phase”’ 
1 ‘quadrature’ components, respectively, at the 
‘row-band-filter output at ¢ = 0. The output of the 
relope detector at ¢ = O will be denoted by the symbol 
Thus, 


De RO) = AUF 4 (12) 


e probability of incorrect dismissal, P;p, is defined as 
Prax = Jere [D << Bl, (13) 


ere B > 0 is some preset threshold level at the output 
the envelope detector. The probability of false alarm 
, 18 defined as 

(14) 


Pa) Un De BB) Aor PO) = 0 


, It is the probability that the output of the envelope 
ector exceeds the threshold in the absence of signal. 
3ecause of the nonlinear action of the limiter, its 
put, L(t) is a non-Gaussian stochastic process. How- 
r, if the bandwidth of the narrow-band filter is small 
ugh compared to the bandwidth of L(t) (although we 
ll not assume it to be so small as to integrate over more 
n one pulse), then its output /(¢) and hence, U and V, 
_be nearly Gaussian. It is assumed that the ratio of the 
ut-noise bandwidth to the bandwidth of the narrow- 
id filter is much larger than unity. The joint statistics 
J and V may then be approximated by an Edgeworth 
es. 

; order to make the subsequent mathematics at all 


| : 3 ales 
stable to numerical evaluation, it is necessary to 


The maximum of the envelope may not occur at the sampled 
instants due to noise fluctuations. However, when the range 
of a radar is narrow, the model assumed in the analysis is a 
onable approximation to an actual radar system. 


approximate the integrals defining U and V by sums in 
such a way that only values of the argument separated 
by 1/W are dealt with. When this is done, U and V are 
each represented as a sum of independent random vari- 
ables. The conversion of the integrals to sums can be 
viewed in at least two different ways: 


1) A method of numerical integration in which the 
mesh size is taken as 1/W. 

2) An approximation of the impulse response H(t) of 
the low-frequency equivalent filter by a series of 
impulses or its step response by a staircase with 
jumps occurying every 1/W seconds.’ 


Thus U and V will be represented as 
k; 


=. || Ie \ =. il ( ) 
— Hy Nh = ; 
C 2D W (4) Ur ie Dd W a W. Vo 


0 0 


(15) 


where 


(16) 


In view of the assumption that the input noise spectrum 
is uniform, one readily determines that X(— k/W) is 
independent of X(— j/W); Y(— k/W) is independent of 
Y(— j/W); and Y(— j/W) is independent of X(— k/W), 
7 # k. However Y(— k/W) is not independent of 
X(— k/W). 

It will be necessary for later developments to deal with 
standardized random variables. To this end let us define 
the standardized variables 

Ue los ee 


1 a ; 
Ou Oy 


: (Go. Sa ar. = V, meme ivap 
Yo = ? 
OV, 


(17) 


Ur a 

Ou, 

where the notation mg and a is used to denote the mean 

and variance of a random variable Q. In terms of standard- 
ized variables, (15) becomes 


Wy = > cy b= Dy iacioe (18) 
0 0 
where 
= gsm () _ low, (2). 
Se = WE cae A seta 


In the following section the bivariate Edgeworth series 
expansion of the density function of U and V will be 
derived. 


’'The absolute accuracy to which the integrals representing U 
and V are approximated by sums is not of prime importance here. 
What we want to determine in this paper is the change in the first 
order statistics at the envelope detector output caused by the in- 
troduction of the limiter. So long as the bandwidth of the narrow- 
band filter is small compared to W, its precise transfer function 
shape (or impulse response) only weakly affects the output statistics. 
Thus, the approximation 2 (above) itself might be considered a 
suitable low frequency equivalent filter for the purpose of this 
paper. 
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EDGEW ORTH SERIES 


By a straightforward extension of the univariate 
Edgeworth series expansion,’’? one may determine a 
bivariate Edgeworth series expansion for the pair of 
random variables (wu, v). To orient the reader, a brief 
discussion of this extension will be given. Let 


F(é, n) = exp [itu + im], F.(g, 1) = exp [teu + inv], (20) 


(where the bar denotes a statistical average) denote the 
characteristic function of the pairs (wu, v) and (uz, Vz) 
respectively. The Taylor series expansion of the logarithm 
of F(é, n) about € = 0, 7 = O takes the form 


~) 
w 


ms: 


ae oe, oS” Yinn (1é) (1m) . 


n=0 m=0 m!n! 


(21) 


where the primed sums indicate that only terms for 
m +n > 3 are to be included in the sum and the semi- 
Invariant Ynn 18 given by 


o” "InFE, n) 
ee og” On" 


Ym ree (22) 


Examination of (21) shows that F(é, 7) may be ex- 
pressed in the form 


FE, 1) = exp E: a A a | 


“a 


bd a aren | 

exp [= > Ymn m! n! (23) 
The first factor in (23) is recognized as the joint charac- 

teristic function for a pair of standardized Gaussian 

, random variables. Let the second factor, defined as 

/ G(é, n), be expanded as follows 


Ce d=epiD D1= DAT ep 


Use of the expansion of G(é, 7) of (24) in (23) leads to 
an expansion of F’(é, 7) in a series of terms each of which is 
a product of the Gaussian characteristic function times 
powers of £, ». Inverse Fourier transforming this series 
term by term leads to an expression for the joint density 
function of u and v in a series, the leading term of which is 
the standardized joint normal-probability density func- 
tion. Subsequent terms involve the derivatives of this 
latter function weighted by appropriate coefficients 
involving the semi-invariants Yn. 

This series expansion as such does not become the 
Edgeworth series expansion until terms of the same 
“order” are grouped together. A series of terms are 
defined to be of the same ‘‘order” if their coefficients are 


“H. Cramer, “Mathematical Methods of Statistics,’ Princeton 
University Press, Princeton, N. J., p. 227; 1946. 

M D. Middleton, “Theory of random noise; phenomenological 
models,” J. Appl. Phys., vol. 22, pp. 1153-1163; September, 1951. 


Ap 


proportional to the same power of the ratio r of the band 
width (suitably defined) of the narrow-band filter to th 
bandwidth of the input noise W. Thus our Edgewortl 
series is an expansion in powers of the bandwidth ratic 
One may show that the semi-invariant Ym, is of th 
order 4(m + n) — 1, ue, 
Vmn pe ee (25 | 
In the expansion of G(é, 7), only Ymn values fo 
m + n > 3 are involved. Thus, following the leadin 
(Gaussian) term, the first correction term in the Edges 
worth series is proportional to the square root of the 
bandwidth ratio. The successive higher-order terms ar 
proportional to 7, 7°”, r’, etc. To determine all the term 
of the same order it is important to note that the “order 
of the product of m semi-invariants 1s equal to the sum of: 
the orders of the individual semi-invariants. If we examin 
the expansion of G(é, 7) in powers of >.’>>’ we note tha 
in a term of the form (>.’>.’)” only products of semi 
invariants taken n at a time are involved. Thus, one ma; 
show that all terms of order + comes from >>’>\’, al 
terms of order 1 come from >.’>.’ and (>.’>,’)’, ete 
In this way it is possible to collect all terms of the same 
order. 
Without going into the tedious details, we find that th 
Edgeworth series expansion for terms up to order 1 is ’ 


Wu, v) = (u,v) — {> Ym,3-m fees} 


; ___Pmis—m 
H (z eee (4 — m)! 
1 es 
a 2 2d = YVm,3-mYn,3—n 
. Pin en, 6—(ntn) ie 
(m!)(3 — m)!n! 3 — =} 7 (26), 
where 
u wu? — Quvw + =| 
me Ree Sie ex a —— A i) 
ou, v) QnV 1 = (w)? P| Oi ea (wv)? ) 


m+n ; 
tnt 9) = EGR 
The first term in (26) in braces is of order 4 and the secon 
term is of order 1. One may readily generalize (26) 
include terms of arbitrary order, however, the number 
terms increases quite rapidly. 4 

It is clear that the desired Edgeworth series may be 
found once the y,,, are determined. By carrying throug 
the indicated differentiations in (22), one may obtail 
expressions for Yn. In terms of the moments of th 
standardized variables u, v. These expressions have beet 
calculated by the authors for m.+ n < 6 and are pre 
sented in Table I. Only those Yn. for m > n are givel 
since Yn, may be obtained from 7,,, by interchanging 2 
and v. It should be noted that yo. = 1 and yo. = Yio = 
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TABLE I 
Semi-INVARIANTS IN Terms or Moments 


3. 2 
aa = UO) 


Bs ya 
= ui — 3; ya = wy — Bun; Yo = uv —2(w) —1 
= uy — 100; ya = uv — 4)(w) — bu 
= uy’ — 6(ur)(w) — 3w? — 
=u’ — 15u* — 10(u*)’ + 30 
= uv — 5(w)(u) — 10) (*) — 10u° + 30u 
= uy’ — 8(w)(u'n) — 6(wWe) — bw? 

— 4(u®)(w?) + 24(w) — ut + 6 
=u? — 3(u'v + v'u) — 9(w") (wr) — 9(w) (wr? 

+ 18w — (w)0*) + 12(w)’ 


= Yo2 = 1, due to the standardization of wu, v. It should 
>» be noted that the relation between the semi-in- 
iants and moments shown in Table I are valid for any 
r of standardized random variables. In particular, 
y apply to the pair (u,, v,) in the sums defining wu and 
see (18)]. Let a typical semi-invariant of the pair 
, Vx) be denoted by Ymnz- Then it is readily deduced 
m (18) and the assumed independence of the pairs 
, %) and (u;, v;), that 


= De YnmieiBi (28) 
decomes clear that evaluation of y,,, depends upon the 
ermination of the typical moment uv, for k = 
1 --- o, [Examination of (19) shows that a, and £6, 
y be determined once this typical moment is found.] 
2 evaluation of this moment is discussed in the appendix. 


PROBABILITY oF INCORRECT DISMISSAL 


‘he probability of incorrect dismissal will now be 
essed in terms of an integration over the density 
ction of the standardized variables. From (12) and 
) it is readily deduced that 


= Pr[- 
SAL ee 


m (17) it is then found that 


Bee UeoB. 


Ce ee Bo Uy. 29) 


= pr | Bat <y Bam, 
ou 


ou 


aN 


(uy + Mu) Sas: 


(30) 


From the results shown in the Appendix, one may show 
that my is zero. Consequently, if we define the function 
A(u) by 


AW V/ B® = (sy + mo) . 


Oy 


(31) 


it follows that 


B-mu/ctu A(u) 
Pip ae / ii 
—-B-mu/cyu J-A(u) 
Because of our choice of s(¢) as indicated in (1) it turns 


out that 
LED ae odd. 
(a 


Thus, in particular, w = 0. This means that instead of 
having to deal with the general ¢(u, v) in (26) we have the 
special case o(u, v) = o(u)b(v) where 


1 2 
o(u) = oe exp a ; 


is the univariate normal probability density function. 

If we examine the Edgeworth series approximation to 
W(u, v) given in (26) we see that application of (82) to 
determine P,;p requires the evaluation of the typical 


integral 
B-mu/ceu A(u) 
Ian =f / 
—B-mu/cu J—-A(u) 


Wu, v) du dv. (32) 


(33) 


(34) 


bmU)on(v) du dv, (35) 


where 


Tote), 


Pm(u) = (36) 


The integration with respect to v may be performed, 
yielding 


0; n odd 


B-mu/cu 
fat os / $n(U)bns[A(w)] du;n even, nx 0 (37) 
B-mu/cu 


B-mu/ctuU 
{| dn(u){26_,[A(u)] — 1} dujn = 0 
—B-mu/cu 
where 


ee) = | 6 a, (38) 
The integrals J,,, were programmed for numerical evalu- 
ation on the ELECOM. 

Our expression for P;p including terms up to order 1 
becomes 


Nay ee eee ee ee 


pies 


sey a mae, ue Alco hag aa ae ee 


8 12 a2) 
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For the numerical results of this paper, the Edgeworth 
series has been calculated for the specific case in which 
the narrow-band filter is a single-tuned high-Q circuit, and 


- = (Aq: jp = eee 
I 1 


(40) 
where 7 is the width of a typical input (square) pulse and 
T is the filter time constant. Curves of P rp are plotted as 
a function of two parameters, S/oV/2 and B/cy. S is the 
peak signal input, ¢ is the rms noise level at the input to 
the limiter, and cy is the rms noise level at the limiter 
output (in the absence of signal). Thus, S/o 1/2 is the 
rms signal-to-noise ratio at the limiter input and B/oy is 
the threshold level normalized with respect to the output 
noise level. 

The actual calculations of P;p employed the Edgeworth 
series approximation for terms up to and including order 
1. Thus the Gaussian approximation (the first term) and 
two correction terms are used. However, it is felt that for 
the range of values of parameters considered, these three 
terms give an accurate representation. An idea of the 
accuracy may be inferred from the fact that the plotted 
curves of P;p with and without the last correction term 
are indistinguishable graphically. In Fig. 2, Pp is plotted 
as a function of S/ov/2 for different normalized thresh- 
olds B/oy = 2, 3, 4, 5. The solid curves apply to the 
system of Fig. 1, while the dashed curves apply to the 
same system without the limiter.° Discussion of these 
curves will be deferred until after the following section 
which takes up the evaluation of Py 4. 


PROBABILITY oF FatsE ALARM 


The probability of false alarm, P,,, has been calculated 
previously for the system of Fig. 1 on the assumption 
that U and V are independent random variables.’ Such 
an assumption leads to the requirement of only a con- 
ventional univariate Hdgeworth series. In this section, 
Py, will be evaluated considering the dependence of U 
and V. The starting point for this evaluation is the 
bivariate Edgeworth series expansion of W(u, v) in (26). 
Considerable simplification results if it is noted that y,.., 
is zero for m or n odd when P(t) = 0, 7.e., no input signal. 
Moreover Ynn = Yam for this case. Also when P(t) = 0 it 
is possible to avoid numerical integrations. It will now be 
demonstrated that both the probability density function 
of the envelope detector output, and the probability of 
of false alarm may be expressed in an Edgeworth series 
involving Laguerre polynomials. 


® When the limiter is absent, one may readily determine that 


ioe whe a2 | it e) /WT, ave 


where Q(a, 6) is the Q function shown in J. I. Marcum, “Tables 
of annuca RAMS Corp., Santa Monica, Callif., Project Rept. 
RM-339; January 1, 1950. 

7J. Galejs and ‘J. Storer “Effects: of Limiting on the False 
Alarm Rate of an Envelope Detector,’ ” Appl. Res. Lab., Sylvania 
aery Products, Inc., Waltham, Mass., Appl. Res. Memo. 135; 
une, 1958. 
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Fig. 2—Probability of incorrect dismissal as a function of signa L 
noise ratio. 


Ife and y are defined implicitly by 


U € cos y 


ee sinny 


then 


Pra = Pr[(D > B] = r fe > eee (42) 
N 


where B/cy is the threshold level in units of rms noisé| 
output. Let the joint density function of e and y be 
denoted by W,(e, ¥) and the density function of e by, 
W.(e), then 

| 


W.Q = | We Way, (43) 
0 

i, 

and ! 
foo} Zs B il 

Pun = i Ae Out: (444 

On i 

W,(e, w) is determined from W(u, v) by i 
Hh 

We, v) = eWee cos y, esin y). (45h) 


If it is noted that 


Ax) = (—1)"H,(a)¢(2), 
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re H,,(x) is the Hermite polynomial of the nth order, 
use is made of the integral® 


[ ; H,,,(e cos ~)H2,(e sin w) dy 


—1)"*"(2n)! (2m)! : 
ser y"*"(2n)! (2m) aac Sh (47) 


2”*"n! m! 


re L,(«) is the nth order Laguerre polynomial 
(7) = 1 — 2x + 2’/2), then one finds (after going 
nugh the tedium of evaluating the semi-invariants) 
t 


0 = een] Shi - Gael) 
aan 15 ) = ES) |} 


‘he probability of false alarm may be calculated with 
aid of the integral 


ai (5) Xx =[Eh2 
\ On 2 e Pp 2 “ 
= pres es) roe i (25)\) 
on on 


‘he probabilities of false alarm with and without the 
‘ter are plotted in Fig. 3 using terms up to the second 
er. This was done in order to have at least two correc- 
2 terms in the Edgeworth series (the terms of order 
are identically zero in the zero signal case). 
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Fig. 3—Probability of false alarm vs normalized threshold. 


DISCUSSION 


rom the curves of Fig. 2, it may be observed, as might 
»xpected, that the introduction of the limiter causes 
apparent degradation in performance: the probability 
neorrect dismissal is higher with the limiter than 
out it for the same value of normalized threshold. A 
sure of this apparent degradation is the db increase 
ignal-to-noise radio needed to achieve the same P 1p 
ithout the limiter (all other parameters being fixed). 
ection of the curves of Fig. 2, for example, shows that 


bid., p. A-10, Eq. (30). 


the increase required is approximately 2.7, 2.1, 1.6, and 
1.3 db for (B/oxv) = 5, 4, 3, and 2, respectively. Such 
values of degradation may be misleading, however, since 
it cannot be said that the limiter has hurt signal detect- 
ability performance unless it can be demonstrated that 
the limiter causes a larger P;p for the same input signal 
strength and the same probability of false alarm (Py4). It 
should be noted that while the curves of Fig. 2 allow a 
comparison of the P;p with and without the limiter on 
the basis of the same value of input signal strength, they 
do not allow a comparison in addition on the basis of the 
same P»,4. Rather they represent a comparison on the 
basis of the same normalized threshold. Consequently, 
one should not jump to the conclusion that the limiter has 
harmed performance by the degree suggested in Fig. 2 
until the P,, with the limiter has been examined as a 
function of the normalized threshold. 

Py is plotted in Fig. 3 as a function of the normalized 
threshold for the cases with and without the limiter. In 
this figure, the bandwidth ratio is 150, and terms of order 
up to and including (1/WT)’ have been used in the 
Edgeworth series. These curves were plotted for values 
of (B/cy) in the range 2 < (B/cey) < 3. For values of 
(B/ov) < 2, the Pr, with and without the limiter are 
essentially identical. For values of (B/cy) to any extent 
greater than 3, Pr, drops so rapidly that the first three 
terms of the Edgeworth series are no longer sufficiently 
accurate to represent P,,4 for the case when the limiter 
is present. 

It is clear from the curves that Py, is less when the 
limiter is used (for the same normalized threshold). How- 
ever, it is also clear that a very small percentage reduc- 
tion in threshold is required when the limiter is introduced 
to maintain the same probability of false alarm as without 
the limiter, at least for 0 < (B/ey) < 3, and perhaps for 
values somewhat in excess of 3. 

For (B/cy) = 3, Pra ~ 10 * with the limiter. Thus for 
probabilities of false alarm < 10“, it may be said that 
the introduction of the limiter necessitates an increase in 
signal strength of approximately 1.6 db, at most (WT = 
150/72, (S/2c)” < 1) to maintain the same probability of 
incorrect dismissal as without the limiter (and with the 
same Pra). For (B/cy) = 5, the Py, without the limiter 
is approximately 10°", and the Py, with the limiter is 
even less. Exactly how much less is not known at this 
point, and to reach an answer would require considerable 
additional work. However, it is clear that as long as the 
Py, With the limiter is less than the P;, without the 
limiter for the same normalized threshold, a comparison 
of Pp with and without the limiter for the same value of 
normalized threshold will always provide an upper bound 
to the degrading effect of the limiter. Thus, we may say 
that for probabilities of false alarm between 10°"* and 
10°*, the introduction of the limiter necessitates an 
increase in signal strength of at most 3 db (WT = 150/rz, 
(S*/20”) < 1) to maintain the same probability of in- 
correct dismissal as without the limiter and with the same 
Pra. 
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APPENDIX 
CALCULATION oF MomMENTS 


The typical moment ujv; may be expressed in terms of 
moments of the unstandardized variables as follows 


— 7 i seu 7 Ly rs pas f s 
Uv, = E k ta E k ue 
Ou; Ov, 


sry. Ls U?Vimy,?ms,”, (50) 


Joeniton cae Salen 


where ie is the combination of m things taken n at a 
time. From (16) and (5), 


UrVi = {cos’ dsin* $} 12 (-x/m)- (51) 


It is not difficult to see (and it will be shown sub- 
sequently) that the moment in braces in (51) is a function 
ofthe ratio P(t)/o V2, where P(t) is the envelope of the 
input pulse train. Thus, we define 


P(t) | 
ut, oa = 
o /2 
The moment /,, in (52) may be computed by averaging 


with respect to the joint density function of R and ¢° 
[see Equation (2)] 


cos’ ¢ sin’ ¢. (52) 


R cos’ ¢ sin’ } 


25 fos) ye) 
M 5a cae / ») 2 
0 0 To 


an ees + P* = aint cos | MEI 


(53) 
a0 
Since the joint density function of R and ¢ is even in ¢ 
while cos’ ¢ sin® ¢ is odd in ¢ for s odd, it is clear that 
M,, = 0 for q odd. For q even, cos” ¢ sin’ ¢ can be ex- 
panded in a finite Fourier cosine series of the form 


2d A; cos (p + gq — 23), 


where 1 = (p + q)/2 for p + qeven, andl = (p+ q-—1)/2 
for p + q odd. With the aid of (53) and the two integrals*® 


cos’ ¢ sin’ ¢@ = (64) 


°W. B. Davenport, Jr., and W. L. Root, “Random Signals and 
Noise,’’? McGraw-Hill Book Co., Inc., New York, ING Da LOG EG: 


(8- 114); 1958. 
10 J. 'L. Lawson and G. E. Uhlenbeck, ‘‘Threshold Signals,’’ 
M.LT. Rad. Lab. Ser., McGraw-Hill Book Cor; Inc., New York, 


N. Y., vol. 24, p. 173; 1950. 
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5S Lf COS gp exp E COS | do = 
fo) 2 2 
(32) | 2" ]a 
a0: o 20 
q 
-| P yee) fs ae | (56 
~ Ln/5e) Te Ae eae 
it is readily shown that 
P 1 P pta-2i jets an j zm! | 
uw. = |= > [ss 1G ae —-273+ 
Re — 20 pg 25 | 


Vee 
elPt4—jpta-itu-$ aay (56) 
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where ,/; (a, 8, x) is the confluent hypergeometric fune 
tion’* and I'(z) is the gamma function. 

According to assumptions previously made, the input 
pulse train envelope, P(é), is given by | 


P(t) = for 
0 for 


ml, — 7 <t <—aT; (57 
(m—1)T> =< haan fa { 
where 7, is the period of the pulse train and m is a | 
arbitrary integer. Since we are examining the envelop 
detector output at ¢ = 0, and since we have assumed that 
Ty) is large enough so or the narrow-band filter integrates 


over only one pulse, we may take 


r(=*) ~ , for O<k<K 58 
OF foray aie . 


where K is the integer that satisfies 


K = Max {Wr —r > 0}; pe UR he Oe (59) 
Thus, 

i 

mi -| tor> ‘Oigle<a hs {i 

wVi = oV2 | 

MSO)" forse ke 


DP, Middleton and V. Johnson, ‘A Tabulation of Selectel 
Confluent Hypergeometric Functions, ” Cruft Lab., Harvard Uni 
versity, Cambridge, Mass., Tech. Rept. No. 140; January 5, 1954 
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On the Asymptotic Efficiency of Locally 
Optimum Detectors” 


JACK CAPON{, MEMBER, IRE 


ummary—A detector examines an unknown waveform to 
rmine whether it is a mixture of signal and noise, or noise alone. 
Neyman-Pearson detector is optimum in the sense that for 
n false alarm probability, signal-to-noise ratio, and number 
bservations, it minimizes the false dismissal probability. This 
ctor is optimum for all values of the signal-to-noise ratio, 
its implementation is usually quite complicated. 
| many situations it is desired to detect signals which are very 
k compared to the noise. The locally optimum detector is 
ned as one which has optimum properties only for small signal- 
oise ratios. It is proposed as an alternative to the Neyman- 
rson detector, since in practice it is usually only necessary to 
2 a near-optimum detector for weak signals, since strong signals 
be detected with reasonable accuracy even if the detector is 
below optimum, 
1 order to evaluate the performance of the locally optimum 
ctor, it is compared to the Neyman-Pearson detector. This 
parison is based on the concept of asymptotic relative efficiency 
»duced by Pitman for comparing hypothesis testing procedures. 
the basis of this comparison, it is shown that the locally optimum 
ctor is asymptotically as efficient as the Neyman-Pearson 
ctor. 

number of applications to several detection problems are con- 
red. It is found that the implementation of the locally optimum 
ctor is less, or at most as complicated as that of the Neyman- 
rson detector. 


INTRODUCTION 


HE FUNCTION of a detector is to examine an 
[aes waveform Z(t) in order to determine 

whether or not a signal is present in noise. We 
ume that the detector’s decision is based on the samples 
e-- ,Z,, 2; = Zt;),t = 1, «++ , n. If we consider that 
) is a sample function from the continuous parameter 
shastic process {Z(t)}, then Z,, , Z, is a set. of 
dom variables. If we assume that these random 
iables are mutually independent, and that {Z(t)} is 
jionary, then Z,, --- , Z, is a set of independent and 
tically distributed random variables. 
hus, the particular detection problem that we are 
Fas is equivalent to a determination of whether 
cumulative distribution function (cdf) of Z;, 7 = 1, 
', n, is G,(z) (signal is present), or is Go(z) (signal is 
nt). The parameter 6 is the signal-to-noise ratio, and 
es the purpose of indexing, or labeling, the cdf Gy(z), 
we have one cdf G,(z) for each 6. In general, @ may be 
tive or negative; e.g., if we are interested in the 
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problem of detecting a constant signal in additive noise, 
6 is equal to the ratio of the amplitude of the signal to the 
rms value of the noise, and will be positive or negative, 
depending, respectively, on whether the amplitude of the 
constant signal is positive or negative. 

The errors committed by the detector are of the follow- 
ing two exhaustive and mutually exclusive types: a) the 
detector decides that a signal is present when in reality 
the signal is absent; the probability of such an error is 
denoted by a,, and is known as the false alarm prob- 
ability; b) the detector decides that a signal is absent 
when in reality the signal is present; the probability of 
this type of error is denoted by £,(@), and is known as the 
false dismissal probability. The dependence of this prob- 
ability on @ is shown explicitly for the purposes of our 
subsequent discussions. 

The Neyman-Pearson detector [1], [2], [8], [13], is 
optimum in the sense that for given a, and n, it minimizes 
8,(@), for all 6. Any other fixed-sample detection method 
must have a larger value of 6,(6), for each 0, and for the 
same @,, 2, as the Neyman-Pearson detector. We observe 
that the Neyman-Pearson detector is optimum for 
all values of the signal-to-noise ratio. In general, the 
structure of the Neyman-Pearson detector depends on 
the input signal-to-noise ratio 6, and changes its form as 
6 changes. As a consequence, the implementation of this 
detector, in certain detection problems, is quite compli- 
cated, as we shall see subsequently. 

In many situations it is desired to detect signals which 
are very weak compared to the noise. Hence @ will be 
very close to zero. It would be desirable in these situations 
to design a detector which has optimum properties only 
for small signal-to-noise ratios. This detector could also 
be used for larger signals. This can often be justified in 
practice by the idea that it is only necessary to have a 
near-optimum detector for weak signals, since strong 
signals will be detected even if the detector is well below 
optimum. 

In the present work we give a criterion for determining 
a detector which has good properties for detecting weak 
signals in noise. This detector is known as the locally 
optimum detector. Under certain weak regularity con- 
ditions for G,(z), the locally optimum detector is usually 
much simpler to implement than the Neyman-Pearson 
detector, and in a certain sense is just as efficient. We 
shall see subsequently that the concept of the locally 
optimum detector is related to some previous work [13] on 
the threshold detection of signals in noise, although the 
methods used here are quite different from those used 
previously. 
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Tur LocaALLy Optimum DETECTOR 


If 8,(@) denotes the false dismissal probability of a 
detector whose false alarm probability is @,, then we say 
that the detector with false alarm probability 6*(@) is 
the locally optimum detector, for @ > 0, if 


ro) dg 


— < - , uniformly in n, 
06 eng OW 


and is the locally optimum detector, for 6 < 0, if 


> 6,10), ay ORT by geiiaage 
6=0 

Thus the locally optimum detector minimizes, or maxi- 
mizes, the slope at 6 = 0 of 8,,(@), depending, respectively, 
on whether @ is greater or less than zero. This definition 
for the locally optimum detector is similar to a definition 
given by Lehmann [4] for locally most powerful rank 
tests. 

Before we proceed to determine the structure, or form, 
of the locally optimum detector we shall state certain 
regularity conditions which will be required in our sub- 
sequent work. 


REGULARITY CoNDITIONS 


(¢) The cdf G,(z), the probability density function 
(pdf) go(z) (= 0 G,(z)/dz), and 0 gs(z)/08 are continuous 
Ms LOC LESTOM eC Oe ee) Or 
almost all z; there exist functions M,(z) and M,(e), 
integrable over (— ©, ~), such that 


< M,@), Us OSG, 


Ogal2 
go2) < Me), | ote) 
The false alarm probability of a detector is given by 


a, = / 2 fends {| Jo(21) Serle Jo(Zn) dz, On 6. i Uo 
I 


(1) 
where J is that region of the n-dimensional sample space 
of Z,, --: , Z, for which the detector decides that there 
is a signal present. Hereafter we refer to the region J as 
the critical region. 

The false dismissal probability 6,,(0) is 


(6) = f -- f gla) 


where J’ is that region of the n-dimensional sample space 
of Z,, --- , Z, which is not included in the critical region. 
We have 


5p) = 35 f o> f gue) 


As a consequence of the regularity condition (7) we can 
interchange differentiation and integration [5] in (3) to 
obtain 


a(n) dz, wees d2n, (2) 


Gols) Oey a ea: 


(3) 


April 


0 


ey B,( 8) 


0=0 


az, 


= fo [plowed ++ gle aes 


the constraint in (1); when @ > 0, the problem is equivs 
alent to choosing the critical region so as to minimize the 


problems by means of a direct application of the Neyman:- 
Pearson fundamental lemma [6]. Thus, when @ > 0, the 
critical region is that region of the n-dimensional sample 
space of Z,, --- , Zn, for which 


ra) n 
06 It go(2i) re 


= °>¢ 
I Jo(2:) 
or 
Tie tame) =+ >, be) Se (5) 

4=1 7 

where 
v2) = Xn wl) 6 
é) = a6 Joie ae ) 


In an analogous manner we obtain that when @ < 0 the} 
critical region is given by 


DG aes aan 


simple in structure. It consists of a device which sums € 
certain function, b(z), of the observations, and a threshold} 


6 > 0, the detector decides that the signal is present 
otherwise, the decision is that the signal is absent. I 
this sum is less than a certain threshold, when @ < 0, the 


decision is that the signal is absent. 

It should be pointed out that the results obtained above 
are quite similar to those obtained previously [13] for the 
threshold-signal design of a detector. In this approach 


a series expansion for the likelihood ratio taken in powers 
of the signal-to-noise ratio around zero signal. It is easily} 


yield the same detector. However, in the previous methods 
it usually is not clear what optimum properties af 
possessed by the locally optimum detector. In the presen 
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‘k this detector is shown to be optimum in the sense 
t it minimizes or maximizes the slope at 6 = 0 of 
)), depending, respectively, on whether 6 is greater or 
»than zero. In addition, in the previous methods it is 
always clear under what conditions the higher-order 
ns in 6 may be neglected. In the present approach 
se terms drop out in a natural way. Another important 
perty of the locally optimum detector, which will be 
sussed subsequently, is that in a certain sense it is 
mptotically as efficient as the strictly optimum 
yvman-Pearson detector. 


ASYMPTOTIC RELATIVE EFFICIENCY 
oF DETECTION PROCEDURES 


n order to evaluate the performance of the locally 
imum detector we shall compare it to the best possible 
ector for fixed a,, namely the Neyman-Pearson de- 
tor. This comparison is based on the concept of asymp- 
ic relative efficiency (ARE) due to Pitman [7], [8]. 
zet us suppose that we have two detectors which are 
igned to detect the same signal, with the same error 
abilities; suppose further, that the detectors require 
aple sizes n, and n., respectively, in order to detect 
signal with the required error probabilities. Then, 
1, < nm. we would be justified in saying that the first 
ector is more “efficient”? than the second, and would 
ose the first detector over the second. The criterion 
1oose the detector which requires the smaller sample 
» for the same 6 and error probabilities,” is, roughly 
aking, the basis for the concept of ARE. The fact that 
s concept is useful in comparing detection procedures 
, been pointed out previously [9], [10]. We shall now 
ke our previous remarks more precise, and give a 
orous definition for ARE. 
et {0;} be a sequence of signal-to-noise ratios such 
t limit;... 9; = 0, and consider two sequences of detec- 
1 procedures {D,}, {D,*}, with false dismissal prob- 
ities @,(0;), 8,£(0;), and the same false alarm prob- 
lity a. Also let {n;}, {n*%} be two increasing sequences 
ntegers such that 


ies) Io 


1 the two limits existing and not equal to either zero 
one. Then the ARE of {D,} with respect to {D,5} is 
ned as 


* 
POPC pees = limit (9) 
is limit exists the same for all sequences {n;}, {n*} 
fying (8). If we denote the statistics on which the 
betors {D,,}, {D,*} are based as {W,}, {W,*}, then the 
EH is denoted as Ly, w* and is given by 


nt 


Ew. we —= limit (10) 


i700 7 


We will now point out that subject to some regularity 
conditions, there is a simple expression for the ARE of 
sequences of detection procedures. We assume that the 
following conditions are true in some neighborhood of 
6 = 0: a) (W, — E,(W,))/oo(W,) is asymptotically 
normal with mean zero and variance one, where E,(W,,) 
and o,(W,,) are, respectively, the expected value and the 
standard deviation of W,, taken under the hypothesis 
that: the. cdf-0f-Z,,0) =, = 711s) G2) a) torethie 


sequence {6,}, where 6, = kn '’’, k is a constant, we have 
Se 
limit co(Ws) = 1 
no ao(W,,) 

and 


Ey limit 


no 


I 


ce a BAW 
6,0" oo(W,,) 
0 2 
Ie E,(W,,) 


limit’ |=. 
n— oo in’ o(W,,) 6=U 


I 


exists, and is independent of k. 

The quantity /y, has been termed the efficacy of the 
detection procedure based on the sequence of statistics 
{W,.}. If conditions a) and b) are satisfied for the de- 
tectors {D,}, {D4}, then it can be shown [8] that 


Ew 
EB ys 


(11) 


Ew, we = 


Thus, the ARE of sequences of detection procedures is 
given by the ratio of the efficacies of the detection pro- 
cedures. 


ASYMPTOTIC EFFICIENCY OF THE LOCALLY 
OptimuM DrErtTEcToR 


It follows from the optimum character of the Neyman- 
Pearson detector that the ARE of any sequence of 
detectors with respect to the sequence of Neyman-Pearson 
detectors must be less than or equal to unity. In particular, 
the efficacy of the Neyman-Pearson detector is greater 
than or equal to that of any other detection procedure. 
We now compute this efficacy. 

It is well known that the Neyman-Pearson detector 
bases its decision on the quantity known as the likelihood 
ratio 


L* a 
Gy = go(2:) 


*y Eny ) a (12) 


Since the logarithm is a strictly increasing function of its 
argument, the Neyman-Pearson detector can base its 
decision on the quantity In L*, given by 


n 


0) ean goles) 


Invi (er nee 
i=1 0) a 


(13) 
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If @ is sufficiently small, and the regularity condition 
(7) is satisfied, the Neyman-Pearson detector can base its 
decision on 


1 n 
Ee, Sr) ) = n be (b(@;) “aie o(1)) (14) 
where 
limit o(1) = 0, uniformly in 4, --,2,.- (15) 


6-0 


Thus, when 0 > 0 the Neyman-Pearson detector decides 
that the signal is present when L/ exceeds a certain 
threshold value; otherwise, the decision is that the signal 
is absent. When 6 < 0 the Neyman-Pearson detector 
decides that the signal is present when L/ is less than a 
certain threshold value; otherwise, the decision is that the 
signal is absent. The threshold value is, of course, chosen 
in each case so that the false alarm probability of the 
detector is equal to the prescribed value. We note the 
similarity of the test statistic L/ to L, [cf. (14) and (5)]. 
We see from (14) that, except for the o(1) term, 
Li(Z,, +++ , Zn, On) is equal to a sum of independent and 
identically distributed random variable. If we assume 
that the variance of the random variable 6(Z) is bounded, 
then we have from the central limit theorem that 
L'(Z,, +++ , Jn, 9,) is asymptotically normal, so that con- 
dition (a) is satisfied. We also obtain from (14) that 


E (LZ, eae) ors 9,)) 
= 2 & In Z| | =O5 Cl) eel G) 


where 


limit 0,(1) = 0. (17) 


no 


If we differentiate (16) with respect to @ we obtain 


S BALM Zs, EAA Ne eit he dy (18) 
6 


=0 
where 


infc, = Ey(b"(Z)). (19) 


The quantity defined in (19) is known as the information 
[14] of the cdf G,(z) evaluated at @ = 0, and in our dis- 
cussions is assumed to be finite. We have from (14) that 
2 3 Lae 

Op (Zanrtse Zi Oey es (infg, + 0,(1)). (20) 
Hence, the efficacy of the detection procedure based on 
the sequence of statistics {Z/} is obtained from (18) and, 
(20) as 


EH, = infg,. (21) 


We shall say that a detection procedure is asymptotically 
efficient if its efficacy achieves the upper bound in (21), 
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Apri 


namely infg,. We will now show that the locally optimum 
detector is asymptotically efficient. 

We see from (5) that L,, is equal to a sum of independent 
and identically distributed random variables, each with 
finite variance. Hence, we have from the central limit 
theorem that L, is asymptotically normal, so that con 
dition a) is again satisfied. We also have from (5) that 


RAUCH A its, (29 
06 426 


and 
Galan Zan eens Zn)) = infg, (2 ) 


so that the efficacy of the detection procedure based on 
the sequence of statistics {Z,,} is 


Ey, = infg,. (24) 
Hence the locally optimum detector is asymptotically 
efficient; 7.¢e., Hz,1. = 1. 

APPLICATIONS 


We now consider a number of detection problems in 
which our results may be applied. Straightforward calcus 
lations show that in each case the regularity conditions 
are satisfied. We observe that in each example the struc 
ture of the locally optimum detector is less, or at most as’ 
complicated, as that of the Neyman-Pearson detector. 


Detection of a Constant Signal in Additive Gaussian Noise 


In this case the signal has a constant amplitude of A; 


variance s’. Thus, the pdf go(z) is 


st) oe 


where @ = A/s is the peak signal-to-rms noise ratio. The 
function b(z) is 


wuld) = Ons')*” exp (—1 (? 


ae Uh 


Og) eae (26) 


statistic 


If we form the likelihood ratio and take its logarithm 
we find that the Neyman-Pearson detector is also based 
on the statistic in (27), for all 6 ¥ 0. Thus, in this cas 
the locally optimum detector and the Neyman-Pearsot 
detector coincide. We note that the structure of the 
Neyman-Pearson detector is the same for all values of! 
6 # 0. This is one of those rare examples in which ¢ 
uniformly optimum detector exists. 1 
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ection of a Gaussian Signal in Independent Additive 
raussian Noise 


n this example the signal is normally distributed with 
an zero and variance r’, and the noise is normally 
tributed with mean zero and variance s’. The pdf go(z) 


4) = (ns. + 0)-”? exp (—42 81 + 8) (28) 


ere 6 = r’/s is the mean-square signal-to-mean-square 
se ratio. The function b(z) is 


b(@) = ye 2 1) (29) 


that the locally optimum detector is based on the 
tistic 


1 Z 
Pa Bp) 
If we form the likelihood ratio and take its logarithm, 
find that the Neyman-Pearson detector is also based 
the statistic in (30) for all @ > 0, so that it coincides 
th the locally optimum detector. Since the structure of 
> Neyman-Pearson detector is the same for all @ > 0, 
/also have a uniformly optimum detector in this case. 


welope Detection of a Sine Wave in Narrow-Band 
Gaussian Noise 


In this detection problem the observed waveform is the 
velope of a narrow-band noise and an additive sine wave 
amplitude A whose frequency is equal to the center 
quency of the noise band. The noise is a Gaussian 
seess with a zero mean and mean-square value s’. 
fee these conditions the pdf g,(z) is given by [11] 


sn (-(E4 dol"), = 


= 0, ee <—s Cel)) 


) 


tere I,(u) is the modified Bessel function of the first 
nd, zero order, and 6 = A’/2s” is the signal-to-noise 
wer ratio. The function b(z) is 


b(z) = 2/28 — 1, (32) 


that the locally optimum detector is based on the 
jes 


1S (Z/28) — W), (33) 
i=1 
(The Neyman-Pearson detector is based on the statistic 


1 yn 1l(Z)20/8*)""1, (34) 


hat its structure is much more complicated than that 
he locally optimum detector. We note that the struc- 
e of the Neyman-Pearson detector depends on @ so 


that no uniformly optimum detector exists for this 
problem. 


Detection of a Sine Wave of Unknown Phase in Additive 
Gaussian Noise 


The signal in this case is a sine wave of amplitude A, 
and unknown phase, while the noise is normally distributed 
with mean zero and variance s’. Under these conditions 
the pdf ga(z) is given by [12] 


Fae ai fe (20) cos )) du (88) 
where 


o(u) = (2m) exp (—3u’) (36) 


and @ = A’/2s” is the signal-to-noise power ratio. The 
function b(z) is 


b(2) = 2¢/s' — 1), (37) 


so that the locally optimum detector is based on the 
statistic 


1d (Ze) — 0. (38) 


The Neyman-Pearson detector is based on the statistic 


“ 2 ((22/2s" + In [ ; (2 — (26) cos u) au) » (89) 


so that its structure is much more complicated than that 
of the locally optimum detector. 
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Frequency Differences Between Two Partially 
Correlated Noise Channels” 


JANIS GALEJS{, MEMBER, IRE 


Summary—Approximate probability distributions of the difference 
frequency between two noise channels which contain dissimilar 
Gaussian, rectangular or triple-tuned RLC band-pass filters are 
calculated. For noise channels that differ only in time delay, a 
proportionality between rate of change of instantaneous frequency 
and the difference frequency is assumed. For dissimilar filters, 
an approximately equivalent single filter-time delay process is 
defined. The single filter is determined from the moment averages 
of the two dissimilar filters, while the equivalent time delay is 
computed by equating the magnitude of the correlation function 
in the two processes. 


I. INTRODUCTION 


HE PHASE difference distribution between two 
Gaussian channels has been examined by several 
authors under assumptions of stationary or non- 
stationary noise or with sinusoidal and Rayleigh dis- 
tributed signals.’-> The phase difference distributions 
characterize performance of phase comparison systems. 
Similarly, the difference frequency distributions character- 
ize the performance of frequency comparison systems. A 
simple model of the latter system is provided by two 
correlated noise channels, the difference frequency of 
which is applied to an ideal frequency detector. The 
amplitude distribution of the frequency detector output 
is the same as the distribution of the instantaneous 
difference frequency between the two noise channels. 
Analysis of FM receiver noise and of fading sinusoidal 
carriers may be quoted among possible applications of 
the above model. The distribution of noise output changes 
of an I'M receiver between times ¢ and t/ = ¢ + 7 may be 
computed as the difference frequency between two cor- 
related noise channels that differ only in time delay r. 
Under the assumption that narrow-band noise exhibits 
the frequency modulation of a fading carrier, two fading 
carriers and the associated receiver circuitry exemplify 
dissimilar noise channels. 
Some of the problems in deriving the difference fre- 
quency distribution will become apparent from relations 
between the difference frequency and the noise com- 


* Received by the PGIT, May 13, 1960; revised manuscript 
received, August 4, 1960. The research upon which this paper is 
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2 M.S. Aleksandroy, “Distribution of changes in phase difference 
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ponents of the two channels. The noise output of the nth 


channel may be represented by 
Vint) = X,() cosaot — Y,(¢) sim aot 


= VX) + Yi) cos [ot + ¢.()], ( 


where 


1 Y,(2) (ay 
X,(6) ’ 


oe) sta 


difference between the two channels becomes 


(0) — (0) = tan”! ae a car } 


Ns 


The frequency difference is simply the time derivative of 
(3). Differentiation of (3) shows that ¢. — ¢, depends on 
8 variables: X1,; Ys, Xo, Ys, Xa, Ya, Xo ev eo 
Y,, Gaussian, the derivatives X,, and Y, are also Gaussian 
provided that the autocorrelation functions of X,, ane 
Y, exist.’ The difference frequency ¢. — ¢; is character: 
ized by an eight-dimensional Gaussian distribution, all 
the ¢. — ¢, probability density may be determined foi 
arbitrarily dissimilar noise channels by integrating this} 
Gaussian distribution. Thus, a transformation of w(Xy 
Y,, X2, Yo, X1, Xs, Yi, Ye) to polar coordinates gimm 
w(R,, Rs, b1, 2, Ri, Re, é:, ds) which may be reduced 
wd. — ¢,) after seven integrations. The characteristié 
function method’ introduces 8 additional integrals. Al 
effort along these two lines undertaken by members 0 
this laboratory has not yielded results readily suited for 
numerical evaluation of w(¢. — ¢,). In a different ap} 
proach,° the cumulative probability of a derivative 


Gaussian distribution. Similarly, difficulties may be @& 
pected by trying to obtain w(¢. — ¢,) from the seconé 
order characteristic function of (¢.— 4). 


* David Middleton, “‘An Introduction to Statistical Communi. 
cation Theory,’’? McGraw-Hill Book Co., Inc., New York, N. Y 
sect. 8.1-1; 1960. 

°J. L. Lawson and G. E. Uhlenbeck, “Threshold Signals, 
M.LT. Rad. Lab. Ser., McGraw-Hill Book Co., Inc., New Yor 
N: Y., vol. 24) sect. 13:37 11950. | 

°J. EH. Moyal, “Stochastic processes and statistical physics 
J. Roy. Statistical Soc., Ser. B, vol. 11, pp. 150-210; 1949. See ej 
pecially p. 179. 
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The problem may be simplified by imposing restrictions 
the two noise channels. For almost fully correlated 
ise channels that differ only in time delay (hence time 
lays 7 are small relative to the reciprocal of channel 
ndwidth B), one may compute the frequency difference 
| + 0.57) — o(t — 0.57) from the phase differences 
f+ 7) — o(t) and ¢(é) — o(¢ — 7), or from ¢(t), (0), 
d (t). The difference frequency is now expressed in 
bi Olsihe noise components X,, V4, Xs, Ys, Xe, Yor 
terms of noise components X, Y and their derivatives 
-Y, X, Y. The distribution of é. — 4, may be determined 
mm the distribution of only six Gaussian variables. 
It is straightforward to obtain the probability density 
the rate of frequency changes w(¢) from the density 
X, Y, X, Y, X, VY). For sufficiently small time incre- 
ents, w(d2 — 1) is proportional to w(¢) and to 7’, and 
e cumulative probability P(|é. — ¢:| < Ad) may be 
timated from P(\¢| < ¢). This development for de- 
rmining (¢. — ¢,) distributions of channels that. differ 
ily in time delay is shown in Sections II and [II and the 
sults are summarized in the first part of Section IV. 
Additional approximations are required for dissimilar 
ter channels. An equivalent Gaussian process will be 
troduced whose output components X,, Y,, x. = Y, and 
,, Yo, Xe, Ys separated in time by 7 approximate the 
itput components of two dissimilar filters X,, Y,, X), 
eso Ys. Se Y.. This is achieved by attempting to 
atch the second moments of the two eight-dimensional 
vussian distributions and by defining the delay time 7 
the equivalent Gaussian process by equating the 
agnitudes of the two correlation functions as indicated 
Section IV. Once the approximately equivalent Gaussian 
ocess (including 7) is defined, the cumulative prob- 
ility P[(¢2 — ¢1) < A d] is computed as it would be 
r channels that differ only in time delay. It is not shown 
yw close the difference frequency distribution of the 
proximate model comes to the actual difference fre- 
iency distribution between the two dissimilar channels, 
it one can define equivalent channels which will give 
o large or too small spreads of difference frequencies. 
ne actual difference frequency distribution appears to 
» between the above bounds and may be expected to be 
»se to the approximate value, as indicated in Appendix 
Il. Jornr PRopaBinity DENSITY OF 
¢ AND ¢ AND Its INTEGRALS 


The probability density of the rate of frequency change 
) and the cumulative probability P(|¢| < ¢)) are com- 
ited from the joint probability density w(¢, ¢). The joint 
obability density w(¢, ¢) is obtained by integrating a 
dimensional Gaussian distribution of the variables 
| Y, X, Y, X and Y. Transforming (3.8-4) of Rice’ to 
: S. O. Rice, ‘Mathematical analysis of random noise,” Bell 


. Tech. J., vol. 23, pp. 282-332, July, 1944; vol. 24, pp. 46-156; 
uary, 1945. 


| 


polar coordinates, one obtains w(R, R, R, ¢, ¢, 6). Now 
w(¢, ¢) 
a i i | i) w(R, R, R, b, 6, 6) db dR dR dk. (4) 
0 0 —o —oo 


The R integration is elementary. The # integration may 
be carried out after changing the variable of integration 
to (R — Rd’). There are no difficulties with R and @ 
integrations. The integrations result in 


= (ps a) ee ue 
T|(pe in 2nd =f b)F + (ps a wae |” , 


wld, >) (5) 


where 


F = (ps — ps) + 4(uips — ws)d + 4(p2 — mid’, (6) 


mo? = 0) = 2x [| aU — to at, (7) 
pa’ = —9'(0) = 2n)* [gi (t = fo at, (8) 
oo? = —n0) = On)! | gH = 10° af, (9) 
pst = pO) = On) [gif = hy at, (10) 
=f of df, (11) 


and where g(f) is the noise power spectrum and f, desig- 
nates the frequency with respect to which the noise com- 
ponents X and Y are defined. The moments (7) to (11) 
may be derived from (61) of Appendix I. The above 
moments expressed as time integrals are shown in (49), 
(55), (57), (59), and (60) of the same Appendix. Moments 
for specific filter characteristics are listed in Appendix II. 

The probability density w(¢, ¢) may be integrated to 
obtain w(¢). Thus 


[Qe My ef 
[a = Zuid ae ele 


pb) = 2 
wd) = 5 (12) 

Although it has been possible to obtain an explicit ex- 
pression for w(¢) with symmetrical spectra,” an attempt 
to evaluate the integral with », ~ 0 and uw; + O was 
successful only for large values of ¢. Hence, 


DOr (13) 


For smaller arguments ¢, w(¢) is obtained numerically. 
The cumulative probability P(|¢| < ¢) is computed by 
numerically integrating w(¢). The cumulative probability 
has been plotted in Fig. 1 for Gaussian, rectangular and 


8 Introducing a variable v = 4¢2p.*[4¢2p22 + (p4 — px)?|7 
and setting 41 = uw; = 0, w(¢d) may be computed with the aid of 
integrals 212.10 and 212.11 of W. Groebner and N. Hofreiter, 
“Integraltafel,” Springer Verlag, Vienna, Austria, pt. 1, 1949. 
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triple-tuned RLC band-pass” characteristics with ey = Pian ee ae P(| Pics Ata). (17) 
us = 0. It is seen that for a given rate of frequency 


change'” 
do = k(rB)’, (14) 


the cumulative probability P(|¢| < ¢o) is smallest for the 
triple RLC filter. A filter with the most gradual cutoff 
exhibits the largest amount of high-frequency output 
components. Its instantaneous output frequency will be 
extended over a wider frequency range (w(¢) 1s a broader 
distribution). High values of ¢ are more likelyin a gradual 
cutoff filter (also a broad w(¢) distribution), which is the 
cause of the lower P(|\é| < ¢) values for $)/(rB)* = 
constant. 
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Fig. 1—Probability of the rate of frequency changes. 


IIL. Revations BETWEEN PROBABILITIES 
INVOLVING INCREMENTS AND 
DERIVATIVES OF A VARIABLE 


A simple proportionality that exists at sufficiently 
small time increments 7 between the probability density 
for a change of a variable Az and the probability density 
of its derivative ¢ is the basis of the approximate method 
described in this paper. From 


Ax = % — 4% = re + O(7), (15) 


it follows that the probability densities for Av and « are 
related by 


WD ONG) vs (16) 


Furthermore, integrating Ar from — Az, to +Avz, shows 
that the cumulative probabilities are related by 


° A synchronously triple-tuned RLC filter is the simplest physi- 
cally realizable band-pass filter for which w(¢) may be defined. 
The autocorrelation function of the output noise from a single- 
tuned RLC filter has a discontinuous first derivative at 7 = 0. 
For a double-tuned RLC filter, the third derivative of the auto- 
correlation function is discontinuous. The parameters p2 and py, 
that are required for specifying w(¢, ¢) are infinite for a single- 
tuned RLC filter. For a double-tuned filter, p, cannot be defined. 

10 is normalized with respect to the bandwidth B squared of 
the three types of filters considered. As defined in Appendix II, 
B in eps is the bandwidth of the rectangular filter, the e~°-5 band- 
width of the Gaussian filter, and the half-power bandwidth of the 
triple-tuned RLC filter. 


An example of the relation between the incremental 
and derivative probability may be provided by deriving 
(12) from the probability density w(A¢, 7). For strong 
noise correlation (7 small), w(A¢, r) may be approximated 
by” 


(co — p — pv )B 
Q07(1 Tile. Cor } 


w(Ad, 7) & 


where 


8 = (p cos Ad + wsin Ad)a * (19) 


and where o, p and u are defined by (11) and (61). Ex-) 
panding p and wu in powers of 7 and using the small angle, 
approximations of sine and cosine functions, cne may 
obtain (12) by using (16). 
The probabilities of the rate of frequency change and 
of frequency increments are related by (16) and (17). Thus, 


; Il es 
w(A¢, T) Sa ie w(¢), (20) 
. Ado | 
P(| Ad | < Ado, 7) = P| $|S< Age). iy) 
Let the cumulative probability 
PI é| <a] =m 22 


be given. Rewriting (14) and comparing the left-hand side : 
of (22) with the right-hand side of (21), one gets 


Ny 


bo = k(nB)’ = Ago/r, (23) 


where the bandwidth B is defined above.’® Substituting 
(23) in (21) and equating (21) and (22) gives 
P[| Ad | < k(rBr)xB, 7] = m. (24) 


IV. DISTRIBUTION oF THE DIFFERENCE FREQUENCY 


A. Identical Band-Pass Characteristics 


The simplest case to consider involves identical band-| 
pass filters in two noise channels and a time delay in one 
of the channels as indicated in Fig. 2. With the cumu 
lative probability P(|¢| < ¢.) = m plotted in Fig. 1 and 


O XY Xp 


FILTER 
| 
I 
| 


Fig. 2—Block diagrams of a two-channel system with identical 
filters and a time delay in one channel. 


————O X,Y ,Xo,¥o 


4 W. B. Davenport and W. L. Root, ‘Random Signals and|{ 
Noise,” McGraw-Hill Book Co., Inc., New York, N. Y., 1958, 
Only ee term 6 of the numerator in Eq. (8.106) is significant for 
(Se Ih 
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time delay 7 given, one may compute Ag, in P(|Ad| < 
_7) = m from (23). This computational procedure will 
nost accurate for small values of 7 or for almost fully 
elated noise in the outputs of the two channels. 


Dissimilar Band-Pass Filters, Aligned Center Fre- 
UeNncies 


he system involving dissimilar band-pass filters may 
analyzed by means of the relations developed for 
ilar filters and for a time delay. The system depicted 
‘ig. 3(a) will be approximated by a system with similar 
d-pass filters as shown in Fig. 2, or by a system in- 
ving a single filter as shown in Fig. 3(b). It is per- 
sible 10 substitute the system of Fig. 3(b) for the one 
‘ig. 3(a) if the second moments of the Gaussian distri- 
ion that characterize the system outputs are the same 
both cases. However, a comparison of the moments 
ed in Appendix I indicates that it is not possible to 
tch all of the moments of Fig. 3(a) with moments of 
. 3(b). Introducing the complex notation 


Ye iY. (25) 


nents like 7*7., 7°7., 72. (also Z*Z,, and -Z*7,) 
Fig. 3(a) will have two distinct values as long as the 
) filters in Fig. 3(a) are dissimilar [h,(x) ¥ h.(x)]. The 
responding expression of Fig. 3(b) have a single value, 
{ filter outputs in Fig. 3(b) may only approximate the 
puts of Fig. 3(a). 


N k(t )eh(t )cosu,t 


FILTER 1 O XV sXjo¥q 


FILTER2 +O Xp.¥o Xoo 


ka(t)=ha(t) cos wat 


k(t)=he(t) cos wot +h, (t) sin wot 
N . . 
@) t KORTE 
FILTER 3 O Lm ALT ALY 
ta—= Xa axon 


3—Block diagrams of the two-channel system and its single- 
| channel approximation. 


he approximate procedure for computing the prob- 
ity distribution of the difference frequency involves 


) The specification of the moments pr, Ms, P2, and p, of 
(7) to (10) for computing w(¢, ¢) and P(|¢| < ¢o). 
The above moments, which are also listed in 
_ Appendix I-B, must be determined from moments 
listed in Appendix I-A. 

The determination of an equivalent sampling interval 
7 = t, — ¢, in Fig. 3(b) in order to relate P(|6| < $0) 
to P(|Ad| < Ado) as in (21). 
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As long as there are two different sets of moments 
corresponding to 1, M3, P2 and p, in Fig. 3(a), their average 
may be used for computing moments of Fig. 3(b). Thus, 


3 : 

Mo = uz (0) = =. (W101) Hf Mia(2))s (26) 
2 

pas = —pi’(0) = = (Poacsy + Paacey)s (27) 
a 

bso = —ps/"(0) = @ (Hse) + p30(2)), (28) 

* Gi 
pio = p, (0) = Dy (Paacr) 1 Psac2y) es 


This choice of moments for Fig. 3(b) minimizes the mean- 
square difference between the moments of the Gaussian 
distributions characterizing Figs. 3(a) and 3(b); the best 
approximation in the least-squares sense, to two different 
quantities, is their average. 

It is desired to determine the time interval 7 = t, — t, 
of Fig. 3(b) in such a way that the probability distri- 
bution of the difference frequency in Fig 3(b) becomes the 
same as in Fig. 3(a). This could also be accomplished by 
selecting 7 such that all the moments of Fig. 3(b) involv- 
ing t ~ 0 become approximately equal to the correspond- 
ing moments of Fig. 3(a). This provides a total of 3 
complex equations [(61)—(63)] for determining a single 
real variable 7. Because of the approximations made, it 
will not be possible to satisfy all of the equations. Rather 
than attempting a least-squares fit of the equations or 
another method for approximately satisfying all of the 
constraints, + will be determined from moments not 
involving derivatives by 


2 2 2 2 
Pa Ua = 1 Ps Tales 


where p,, Va, Py and mw, are given by (48) and (61). For the 
constant mean-square noise output of filters in Fig. 3(c) 
and Fig. 3(b) (of = o; = o°), this specifies identical 
probability distributions of the phase difference.’” With 
(30) satisfied, it is possible to obtain various probability 
distributions of difference frequency. A heuristic argu- 
ment*’ may be used to show that the moments (26)—(29), 
used in conjunction with 7 from (80), give a probability 
distribution of difference frequency which lies between 
two limiting frequency distributions. The limiting dis- 
tributions appear to have a wider and narrower spread of 
difference frequencies than the actual distribution of Fig. 
3(a). Although it has not been determined how close this 
approximation comes to the actual differene frequency 
distribution, the two limiting distributions may be so 
close that a more accurate error calculation is not 
warranted. The computation of 7 is made from (30) after 


(30) 


2 Tt follows from (12) that w(@ — mi) = [((1_ — 6o?)/7?]- 
[Cli = Bot) /7? see ema lsh? where | Bo" = (op? =F n?)/o4 (as) da 
7? (p2 — mi®), and is related by (16) to w(A¢ — wir). The probability 
distribution of the phase difference A¢ about its average wit = w/o? 
is thus determined by §.? which has been also shown by Bello, 
op. cit. 

13 See Appendix III. 
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expanding the moments p, and w,. Thus, 
2 t 
2 T T 
po/o Fl — > pe + og Pay (31) 
re 
by/o ee) Ub = Ce M3. (32) 


Substituting (31) and (32) in (80) and neglecting powers 
. : 4 
of + higher than 7, one gets 


(pp + ua)/o* 1 — 1(p2 — 1) 
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D. Additive Noise and Nonstationary Channels 


Additive noise and nonstationary channels can_ be 
handled by methods described earlier.” 

Additive noise increases the total noise-power output 
of a channel without increasing the correlated noise 
portion. The normalized correlation coefficient of the 
channels is decreased and (p, + p2)/(cie2) should be 
replaced by 


pa + Ma 
(a; as i cxaay) (Ge + 2 (aaa)) j 


where o, and opiaaa) are the RMS values of the original: 
and the additive noise of the nth channel, respectively.! 


: a \ come ee 
ie eo 


A less accurate value of 7° is obtained by neglecting the 
7 term in (33). This gives 


1 Pa + Ma 

“sa 4 

2 oO 

CS : (35) 
f2 — Bt 


C. Filters with Misaligned Center Frequencies 


The previous calculating procedure must be modified 
if the two filters of Fig. 3(a) differ in center frequencies. 
For symmetrical band-pass filters, the probability density 
of the instantaneous frequency deviations w(¢) in (12) is 
symmetrical about the filter center frequency w;, and the 
average value of the instantaneous frequency w; + ¢ 1s 
simply w;. The average value of the frequency difference 
between the two filters in Fig. 3(a) is the difference 
between these center frequencies, w; — w,. The difference 
frequency of Fig. 3(a) was estimated from the rate of 
frequency change of ¢ in Fig. 3(b). The average value of 
¢ should satisfy 


$ = Ad/t = (w, — &)/7, 


according to the earlier development. The probability 
density w(¢) computed from (5) is symmetrical about 
¢ = 0. ¢ # 0 and may satisfy (86) only if the center 
frequency of the filter in Fig. 3(b) is swept. Such a fre- 
quency sweep may be accounted for by changing the 
variable ¢ to (6 — ¢) in (5). The noise components X,Y, 
and X,Y, can be defined with respect to the instantaneous 
center frequency of the filter at times 7, and 72, re- 
spectively. The moments 4, p2, ws and py are computed 
for the individual filters and their average is used for 
the computation of w(¢), similar to that indicated in 
(26)—(29). The equivalent delay time 7 is computed as in 
(30), or in (34) and (35). 


(36) 


Increasing amounts of additive noise decrease the left= 
hand side of (30), which results in increased equivalent 
time delays 7 from (34) or (85). 

In the quasi-stationary approximation, time-varying 
channels can be analyzed by considering the time varias 
tion of the instantaneous channel parameters. Thus) 
time-varying doppler shifts or a frequency modulation 1s 
accounted for by introducing appropriately time-varying 
filter center frequencies. The quasi-stationary approxk 
mation becomes inaccurate for rapid changes of channel 
parameters.’’”* 


V. Discussion 


The problem of determining difference frequency dis 
tributions between noise channels that differ only in time 
delay is fairly straightforward. This was shown in Section 
IV-A and will not be discussed in more detail. 

The approximate method for analyzing channels with 
dissimilar filters involved matching of second moments 
between the two-filter system to be analyzed and_ thé 
equivalent single-filter time-delay system. This approxi 
mation will be compared with several other single-filtel 
time-delay systems. A number of such equivalent systemt 
for approximating the difference frequency between thé 
triple RLC filters of relative bandwidth difference 
6 = (Bb, — B,)/B, = 0.05 and of relative center frequency 
misalignment 2 = (f; — fr)/Bs; = 0.2, where B, = OF 
(B, + Bz,), is depicted in lig. 4 along with the correspond 
ing 50 per cent and 90 per cent confidence intervals of th 
difference frequency Ad, and Ad¢,. The system of Fig 
4(b) provides the best moment match with Fig. 4(a) 


“EE. J. Baghdady, “Theory of low distortion reproduction 6 
FM signals in linear systems, “IRE Trans. on Cracurr THEORY 
vol. CT-5, pp. 202-214; September, 1958. 
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ne filters of Fig. 4(c) are of the same type as in Fig. 4(a), 
it of intermediate bandwidth and center frequencies. 
ne second moments of Fig. 4(c) do not depend on the 
lative bandwidth difference 6 of the filters of Fig. 4(a) 
ne system of Fig. 4(c) is most easily handled analytically 
ice only the equivalent time delay 7 is affected by 6 
id Q. The systems of Figs. 4(d) or 4(e) and of Figs. 
f) or 4(g) provide difference frequency distributions 
at are narrower and wider than the unknown distri- 
ition of Fig. 4(a). Figs. 4(e) and 4(g) illustrate noise 
ectra that are skew about fy. The numerical difference 
equency figures indicate a negligible change between 
igs. 4(b) and 4(c). This change will be decreased even 
rther with more accurately aligned filters.’ The upper 


15 The moments p2 and py, are larger in Fig. 4(c) by a factor 
+ «), where x is proportional to (6%). Increased moments de- 
ease w(¢, ¢) of (5) and increase the value ¢o for P(| d | < do) = 
nstant. This change in ¢o is decreased as 6 decreases. 


(a) Bre 
B, fo 

(b) 
EA 

(ce) aan 
Bats 

(d) ae 
Boe 

(e) Beatty 

(f) Pao 
By» fy 
WES 

‘s) Bo» 2p 


P(| Ad | < Adi) = 0.5 
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and lower bounds of difference frequencies’ are separated 
by 6, which is 5 per cent in the examples of Fig. 4. 

The previous example tends to justify the use of the 
equivalent diagram in Fig. 4(c). This diagram will be used 
in comparisons between Gaussian, rectangular, and 
triple-tuned RLC filters. Table I summarizes the 50 per 
cent and 90 per cent confidence intervals of the difference 
frequency A¢, and Ad, that are normalized with respect 
to the average bandwidth B;. It is seen that rectangular 
filters exhibit the largest Ad, and Ad, values for close-filter 
tolerances (6 and Q small). Although for P(|¢| < ¢o) = 
constant in Fig. 1, the rectangular filter exhibits the 
smallest ¢/(7B)” values, Ad is proportional to both 7 and 
@ from (23). The ratio of the equivalent time delay 
between the rectangular filter and the other filters is 


16 Change in difference frequencies between Fig. 4(d) or 4(e) 
and Figs. 4(f) or 4(g). 


5, /2nB3 4g, /2n B, 
? ve 
0.2485 1.128 
0.248 1.128 
0.2u3 1.10 
0,256 1.155 


Fig. 4—Equivalent diagrams for computing difference frequency 
between two dissimilar triple-tuned RLC band-pass filters. In 
Fig. 4 (c)-(g), X1¥1 X2 Y2 are defined with respect to fo. 


By = 0.5 (By + B2) 
P(| Ad | < Adz) = 0.9 
Q = (fi — fe)/Bs = 0.2 


TABLE I 
DIFFERENCE FREQUENCY BETwEEN Two Noise CHANNELS WITH GAUSSIAN, RECTANGULAR 
AND TRIPLE-T'uNED RLC Banp-Pass FIurEers 


Gaussian Rectangular Triple RLC 
Q Ad: /2rB, Ad2/27B, Adi/2rB, Ad2/27B, Ad; /27B, Ad2/27B, 
0.01 0.0056 0.04 0.035 0.24 0.017 0.077 
0.05 0.028 0.16 0.0775 0.54 0.061 0.278 
0.20 0.011 0.65 0.155 1.08 0.24 ies 
0.01 0.02 0.12 0.055 0.38 0.061 0.278 
0.05 0.034 0.2 0.0775 0.54 0.085 0.386 
0.20 0.1135 0.66 0.155 1.08 0.248 ileal 
Note: P(| Ad | < Adi) = 0.5 P(| Ad | < Adz) = 0.9 


5 = (By, — B,)/Bi 


Q = (fi — f2)/B, 
B; = 0.5( Bi + B2) 


The bandwidths B,, of the different filters are defined as in footnote 10 or Appendix II. 
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largest for small 6 or ,'’ which causes the larger A¢; 
values in Table I. For larger 6 or Q, the ratio of the equiva- 
lent time delays between the rectangular and other filters 
is decreased and the effect of the larger ¢/(#B)* values of 
the triple RLC filter tends to predominate. For larger 
alignment errors 6 or 2, the triple RLC filter exhibits 
larger Ad; values than the sharper cutoff rectangular or 
Gaussian filters. The data of Table I can be readily 
extended to other values of 6 and Q by means of the 7 
relations given in Appendix II and to probabilities 
P # 0.5, 0.9, with the aid of Fig. 1. 

The above examples are indicative of channel tolerances 
required for achieving a prescribed level of difference fre- 
quency fluctuations. It should be remembered that the 
accuracy of the results depends on the degree of noise 
correlation in the two channels. For a high degree of noise 
correlation or for small dissimilarities in the filter 
characteristics, the proportionality between the corre- 
sponding probability densities is almost exact. Also, the 
approximation of two different sets of second moments 
of a Gaussian distribution, by their averages, appears to 
introduce a smaller error (the per cent difference between 
the upper and lower bounds of the difference frequency is 
decreased) under similar conditions. 


APPENDIX I 
MoMENTS OF THE GAUSSIAN DISTRIBUTIONS 
CHARACTERIZING Two NoIsE CHANNELS 


A. Dissimilar Filters in the Two Channels 


Complex notation’ is introduced in this Appendix 


in order to condense the derivation of the various second 
moments. The filter inputs and outputs of Fig. 3(a) may 
be represented as”° 


V; = X CoS wot — Y SiN wot = Re (ee'**’), (37) 
Van = X,. COs. wol —<Y, sin’ agin= He' (Zee). (38) 
The impulse response of the nth filter is 
kG) =e hie se) an (39) 
where 
An = Wn — o, (40) 


7 ~ Vi 6 | or V| Q | in (97) for rectangular filter, 
while 7 ~ V K6& + 2 for the other filter types in (86) and (109). 

18 R. Arens, ‘“Complex processes for envelopes of normal noise,” 
IRE Trans. on INFoRMATION THEORY, vol. IT-3, pp. 204-207; 
September, 1957. 

19 J. Dugundji, “Envelopes and pre-envelopes of real wave- 
forms,’ IRE Trans. on INrorMATION TuEorRy, vol. IT-4, pp. 
538-57, March, 1958. 

20 The noise components z, y and X, Y may also be defined with 
respect to the center frequencies of the two filters w,. This will 
make the second moments involving noise components of both 
filters time varying. However, sums of squared moments like 
(XX)? + (YY)? or corresponding expressions involving deriva- 
tives of the noise components remain constant and are not affected 
by the various choices of center frequencies. 


and where h,(¢) is real if the filter is symmetrical wit nh 
respect to its center frequency w,. The complex envelopes 
of the filter outputs 


are related to the complex envelopes of the filter inputs 
2 =a ae, (42) 


and to the complex envelope of the filter impulse response 
ie by 


Zt) = 0.5 f 2(t — whglude’?™ du. (43) 
Furthermore, with h,,(¢) real, 


hh (OP) iy h,(u)ho(vje*(wzje 7°"? du do. (44) 


Assuming that 

ru)y) = ce)yu) = 0, 
it follows that 
2*(uje(v) = 22(u)x(v) 


= 2] gif) cos [(w — w)(u = v)] a. 
0 

For input noise N of constant spectral power density | 
4 wo, (46) simplifies to 5 
2*(we(v) = 8wo d(u — v). (47) } 

Substituting (47) in (44), one has 
Po + jt, = 0.5242, = Wo | hy(u)ha(ue°?* du; (48) 
further, 
o, = 0.5Z*Z, = wo i} hi(u) du. (4 ) 

Changing the variable of integration in (43) to 


w=t—u (50), 


gives 


ZO Hl 2(w)h(t — wei" dw, (51) 
where w, = ¢ for physically realizable filters and where 
w, = © for physically nonrealizable filters which exhibit) 
a nonzero impulse response for negative times. The 
differentiation of (51) with respect to ¢ may be carried out 
under the integral sign, provided that h,(0) = 0 for the 
realizable filters. Changing back to the wu variable gives 
Zi) = 0.5 | 2(t — wiht) + 7 Aha]el™ du. (62 
The moments involving derivatives may be computed | 
from (43), (47) and (52) as follows: I 


6 1 
n a ten es 0.522, 


= wy | halidlha(ed + § Asha(adle "4 du, (68) 
+ fil, = 0.5ZAZ, = wy | tha) — j AshuG) 
[halu) + j Asholudle"2" du, (5d) 
ith m = n in (538), 
that = 0.5LAZ,/j = wy Ay | Ae(u) du = Ajo? (55) 
nce 
| heii) du = = fo | Huis) P do = 0. (66) 
/ith m = n in (54), 
:Paatny = 0.5292, = wy | RQ) + Az] du. (67) 
Vith 
a(t) = 0.5 f elt = hha) + 23 Avi, 
— Azh,(u)]-e7°"” du, (58) 


1e additional moments for specifying w(X, X, X, Y, 
', Y) are 


2 


il = ; re 
nb3a(n) = 23 Lage — Wo a, | [2h;.(u) cna h,(u)h,(u)| du 


+ wy A f RQ) du, (59) 


32, 


2 
rP4u(n) = 


= wf (thin) — AOOP + 2 AAP} du. (60) 


. Edentical Filters with Time Delay in One Channel 


ee second moments of the filter output in Fig. 2 or 
ig. 3(b) are as follows: 


po + fin = 0.5242, = | gle” af, (61) 
(0) 


here Z, is defined by (41) and where g(f) is the power 
ectrum of the filter ouput. The moments involving 
erivatives are” 

ACA = =O a: = 


pe, = jus ) (62) 


0.5242, = —(ps’ + jus’), (63) 


I 


21. O. Rice, ‘Statistical properties of a sine wave plus random 
ise,’ Bell Sys. Tech. J., vol. 27, pp. 109-157; January, 1948. 
e Appendix II. 
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(8) 
o Pos = 0.5272, a 1p, (0); (64) 
o by = 0.52*Z,,/j a u5(0). (65) 


The additional relations for specifying w(X, X, X, Y, 
Y, Y) are 


o he, = 0.07 12,/9 = —peeO), (66) 
o pss = 0.5Z%Z,, = p» (0). (67) 
In the above equations, the dots and primes denote 


differentiation with respect to ¢ and 7 respectively. 


ApprENpIx II 
PARAMETERS OF SPECIFIC FILTERS 


A. Gaussian Filter 
A Gaussian filter of e-°°’ power, bandwidth B,(cps) 

has a transfer characteristic 
(jo) ag Whip exp [—¢ eis ta eae 


where the plus and minus signs refer to negative and 
positive frequencies respectively. The corresponding 
impulse response envelope is 


(68) 


h,(t) = 22 A,B, exp [—(xB,f)’]. (69) 


Computing the moments of individual channels in Fig. 
3(a) by (7)-(10) or by (55), (57), (59) and (60), 


Hiainy = 2(fn — fo), (70) 
Poainy) = 7 [Bn + A(fn — fo)’], (71) 
Hon) = ™ (fn — fo) (6B, + 8G, — fo)’l, (72) 
Paainy = (BB, + 24(f, — fo) Br; (73) 


where difference frequency terms in powers above the 
second have been neglected. The moment averages are 
computed with a reference bandwidth 


B; = 0.5/6; + B,). (74) 
With 
B, = BA + 9), (75) 
it follows that 
B; = B,1 + 0.5 6). (76) 
Normalizing the filter gain by 
[x@ dx = 4rA2B. { Crete 
= 2\/2rA7B, = constant, (77) 
the amplitudes A, are related by 
Axe Ah Oa (78) 
At An (Vea OF O)me (79) 
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Defining the noise components X,, Y, and X., Y2 with 
respect to the filter center frequencies f,,, 


Peel (80) 
and 
1 = ws = O, (81) 
po = wB3(1 + 0.25 8), (82) 
ps = 3n'°B3(1 + 1.5 6), (83) 


. . 2 
where terms with powers higher than 6 have been neg- 
lected. Letting 


Q = (fi i fo) /Bs, (84) 


(48) gives 


(Past a)/ c= Ie OL5 ro ate (85) 


Computing the equivalent delay time 7 from (84) or 
(35) 


1B; 0.5 6 + 0, (86) 


where powers of 6 and 2 above the second have been 
neglected. 


B. Rectangular Filter 


A rectangular band-pass filter of bandwidth B,(eps) 
and of amplitude response A, has an impulse response 
envelope 


h,(t) = 2A, sin 7B,t/(at). (87) 


Computing the moments of the individual channels in 
Fig. 3(a) by (7)—(10), one has 


Mia), — 204, — fo) ee (88) 
Pram = W [B,/3 + 4(fn — foy ] + °°: (89) 
Peso ne fo) 2a eS Uy) Weta (90) 
Pao) = ® [0.2B, + 8G, — fo) Bal + --- (91) 


Defining the reference bandwidth B; as in (74) and re- 
lating the bandwidths B, by (75) and (76), normalizing 
the filter gain as in (77) gives 

4A°B,, (92) 


The amplitudes A, are related as in (78) and (79). 
Applying (80), the moment averages become 


constant. 


1 = ws = 0, (93) 

p2 = (n° B3/3)(1 + 0.25 8), (94) 

pee tO2n Biber 1.5 .3°), (95) 
Applying (84), one gets from (48) 
1—|6|/+2°e 

(pe + us)/o = J ECE al teeta ae eee (96) 


1—|20|+0+18 


for Uf wie nanos 
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Computing the equivalent delay time 7 from (34), 
Se 
s(| 0) +S) a3 


for |f, — fe |/Bi < 0.56 


(97) 


6(| 2 | + 0.30" — 0.125 *) x6 | Q | 


2p2 2 
a Bor 


for ete yal Ie |/B, = 0.5 6. 
C. A Triple-Tuned RLC Filter 


A triple-tuned RLC filter is the simplest physically 
realizable filter for which the probability density w(¢, ¢) 
may be defined.” A triple-tuned RLC filter of half-power 
bandwidth of B, cps has an impulse response envelope 

h.@) = A, 27 Ong, 1 cme ae (98) 
where 
C008 B (99) 


Ignoring the two per cent difference in (99), B, may be 
substituted for a, in (98). Computing the moments of the 
individual channels in Fig. 3(a) by (55), (57), (59) and 
(60) one gets . 


Miatn = 2m(f, — fo) + °° (100) 
Pram) = 7'[4B2/3 + 4(f, — fo)"] + °°: (101) 
Msainy) = 8a'(f, — fo) [Bi + (fe — fo)"] +: (102) 5 
Pian) = 16*[Bt + 2(f, — fo)"Ba] + +++ (103) 


The bandwidths B,, B, and By; are related as in (74) to 
(76). Normalizing the filter gain as in (77) gives | 
0.757B,A,, (104) | 
The amplitudes A, are related as in (78) and (79). Apply- 
ing (80), the moment averages become 


constant. 


Pa Sa 3 ae 0, (105) 
po = (4/3) B21 + 0.25. 8°), (106). 
ps = 167'°B3(1 + 1.5 8°). (107) 


Eq. (48) gives 


(p, + pa)/o* = 1 — 1.25(8 + 07). (108) 


Computing the equivalent time delay from (34) or (35), 
= 13(o + ©). (109) 


2 272 
eT 


AppEnprx III 
Accuracy ESTIMATES 


Two limiting difference frequency distributions may 
be obtained by selecting the moments p1, us, po and p, of 
the filters 1 or 2 of Fig. 3(a) as the moments of filter 3 in. 
Fig. 3(b). The moments of the individual filters provide 
a moment-match between the two Gaussian distributions 
characterizing Figs. 3(a) and 3(b) that is inferior (in the 
least-squares sense) to the average moments of (26)—(29). 
Kgs. (26)-(29) may be expected to give a better accuracy 
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erence frequency distribution than the corresponding 
ments of filters 1 or 2. Although no proof of this will 
given, a heuristic argument may partially support the 
yve statement. 

This explanation will be given for filters that differ in 
adwidth, but whose relative skewness is constant. As 
g as the two filters have a power response symmetrical 
yut the center of the filter pass band, constant relative 
whess implies that the ratio 2, = A,/2rB, = 
— wo)/27rB,, remains constant. (, = center frequency 
the filter, noise components X, and Y,, are defined with 
pect to w, B, = filter bandwidth.) The moments p, 
1 uz, ps and px are then proportional to powers of 


22 2 
, and (5) may be rewritten as 


wé, 4) = Br, &). (110) 

tegrating (110) gives 
w(¢) = By*g(¢/B>). (111) 

tegrating (111) gives 
PUG) <4) = [Bet %) as =0(%)- cy 

a De, 

yplying (21), one has 

BEAR P= wAg, p= n( 28s). (113) 


With + ~ B;," (this follows from (34) if the moments 
» proportional to powers of B,), 


PE dear Aone * ee 
P(| Ad | < Ago; T) pea n( Ae) ae hy Be 


(114) 


~ This can be seen from the expressions for moments given in 
pendix IT. 


For P(|Ad| < Ado, 7) = constant, (115) 
oe = constant (116) 

or 
Ado ~ B,. (117) 


The wider spread of difference frequencies is associated 
with the wider filter. The intermediate filter bandwidth 
B, ~ 0.5 (B, + B.) in Fig. 3(b) has a distribution of 
difference frequencies that is intermediate between those 
of filters 1 and 2. 

It must still be shown that the difference frequency dis- 
tribution in Fig. 3(a) approximates the difference fre- 
quency in Fig. 3(b) if B; ~ 0.5 (B, + B). The selection 
of r in (34) ensures the same amount of correlation 
between noise components X,Y, and X,Y, in Fig. 3(a) 
and in Fig. 3(b), regardless of the bandwidth of the filter 
No. 3. The difference frequency in the output of Fig. 3(a) 
is the difference of the phase derivatives ¢ between two 
correlated pairs of variables X,Y, and X2Y.2, one of which 
exhibits a wider ¢ spread than the other. 

The difference frequency fluctuations in the output of 
Fig. 3(b) are measured between similarly correlated pairs 
of variables X,Y, and X,Y., the frequency spread of 
which depends on the bandwidth B;. The narrower filter 
of Fig. 3(a) when used as filter No. 3 would provide too 
small frequency fluctuations and hence differences. The 
wider filter would provide too large frequency differences; 


the filter bandwidth 
1Bys = 0.5(B, + 15) (118) 


may be expected to approximate the difference frequencies 
of Fig. 3(a). 
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Complementary Series” 


MARCEL J. E. GOLAYf, FELLOW, IRE 


Summary—A set of complementary series is defined as a pair 
of equally long, finite sequences of two kinds of elements which 
have the property that the number of pairs of like elements with 
any one given separation in one series is equal to the number of 
pairs of unlike elements with the same given separation in the 
other series. 

(For instance the two series, 1001010001 and 1000000110 have, 
respectively, three pairs of like and three pairs of unlike adjacent 
elements, four pairs of like and four pairs of unlike alternate ele- 
ments, and so forth for all possible separations.) 

These series, which were originally conceived in connection 
with the optical problem of multislit spectrometry, also have pos- 
sible applications in communication engineering, for when the 
two kinds of elements of these series are taken to be +1 and —1, 
it follows immediately from their definition that the sum of their 
two respective autocorrelation series is zero everywhere, except 
for the center term. Several propositions relative to these series, 
to their permissible number of elements, and to their synthesis 
are demonstrated. 


INTRODUCTION AND DEFINITION 


SET OF complementary series is defined as a pair 
EN of equally long, finite sequences of two kinds of 
elements which have the property that the 
number of pairs of like elements with any given separation 
in one series is equal to the number of pairs of unlike 
elements with the same separation in the other series. 

(For instance, the two series A = 00010010 and 
B = 00011101 are complementary.) 

Series having the complementary property defined 
above were conceived originally in connection with the 
optical problem of infrared multislit spectrometry dis- 
cussed in former publications.’’” In this application, which 
will be recalled briefly, almost the entire available field of 
the spectrometer is utilized, as illustrated by Fig. 1, instead 
of limiting its utilization to single entrance and exit slits, as 
is done in the ordinary spectrometer. This field is divided 
into four entrance portions, a, a’, b and b’, and the four 
exit portions into which the entrance portions are exactly 
imaged (with inversion) by radiation of the “proper” 
wavelength, z.e., by the radiation to be measured (Fig. 1). 

The a portion consists of a series of open or ‘‘closed”’ 
slits, from 40 to 200 in numbers, each slit being open or 
closed in accordance as to whether the corresponding 
element of the first of a pair of complementary series, 
A, and B, is a “one” or a ‘‘zero.’”’ In the a’ portion, the 


* Received by the PGIT, May 28, 1960; revised manuscript 
received September 20, 1960. 

t Philco Corp., Philadelphia, Pa. 

1M. J. E. Golay, ‘Multislit spectrometry,” J. Opt. Soc. Am., 
vol. 39, p. 487; 1949. 

2M. J. E. Golay, “Static multislit spectrometry and its applica- 
tion to the panoramic display of infrared spectra,” J. Opt. Soc. Am., 
vol. 41, p. 468; 1951. 


open slits of a are closed slits, and vice versa. The } 
portion is made up likewise of open or closed slits in 
accordance with the B series, and in the b’ portion the 
open slits of b are closed, and vice versa. 


When the left or entrance half of the square field” 


illustrated by Fig. 1 is uniformly illuminated by poly- 
chromatic radiation, which is imaged as a spread spectrum 


onto the right or exit half of the field, radiation of the 
proper wavelength images all the open slits of a and a/ | 


onto the corresponding open slits of a and a’ at the exit 
half, and the radiation so passed contributes to the output, 
D, of a detector designed to measure the output of the a 
and a’ exit portions. Likewise, all of the radiation of that 


same wavelength passed by the 6 and b’ portions of the» 


entrance field will be exactly blocked by the exit portions 
b’ and 8, respectively, while the remaining radiation exit- 
ing through the b’ and 6b portion will be measured by a 
detector giving an output D3. 


ENTRANCE EXIT 


Fig. 1—Field utilization in multislit spectrometer. 


For radiation of a different wavelength causing the | 


image of the left half of the field to be shifted 7 slitwidths 


on the exit half, the number of open pairs of slits per- 
mitting the a — a and the a’ — a’ passage will be equal | 


to the number of pairs of j-separated like elements in the 
A series. On the other hand, the number of open pairs of 
slits permitting the 6 — b’ and the b’ — b passage will 


be equal to the number of pairs of 7-separated unlike 


April 


elements in the B series. Since this number equals the 4 


number of j-separated like elements in the A series, it 


follows that the difference D, — D, between the measures | 
of the two radiation bundles passing the exit half of the 


field will be unaffected by any radiation except that of the | 


proper wavelength, and will constitute a measure of much 
more radiation of that proper wavelength than if single 
entrance and exit slits had been utilized. 


The basic property of complementary series may be 


expressed also in autocorrelative terms. Let the various 


a; and b; elements (¢ = 1, 2, --- n) of two n-long comple-}} 


mentary series be either + 1 or — 1, and let their re-]} 


spective autocorrelative series be defined by 


i=n-j 


Cc; = 3, A;Ai+; 
i=1 


61 Golay: 


iret OD WEA 
i=1 
e have 
¢; +d; =0 j ~ 0 
Co ob ale = 2n. 


his autocorrelative property of complementary series 
ay lead to applications in the field of communication in 
-called horizontal modulation systems, which permit 
veral communication channels to utilize simultaneously 
e same frequency bands. These modulation systems are 
‘quiring increasing importance. 

Regardless of past or possible future applications, the 
riter has found these complementary series math- 
natically appealing, first because of the deep seated 
mmetries which characterize them, even though no 
on of order may be obvious at first glance, and second 
scause of the challenge offered by the problem of syn- 
esizing them for n = 26, 34, ete. 


CoNVENTIONS AND TERMINOLOGY 


‘Two pairs of elements will be termed like’ pairs when 
th are pairs of like elements or when both are pairs of 
alike elements; otherwise they will be termed unlike 
urs. 

Wherever convenient, pairs of like or unlike elements 
ill be termed even and odd pairs, respectively, and a 
1ad of four elements will be termed even or odd depend- 
g upon whether this quad can be decomposed into two 
<e pairs or two unlike pairs. 

Pairs of elements which are distant an even number of 
ements will be termed even spaced pairs, and the others 
ill be termed odd spaced pairs. 

Whenever each element of a set is replaced by an 
pment of the other kind, it will be said that these ele- 
ents and the set are altered, and this operation will be 
dicated by a prime. 

In all that follows, the two kinds of elements will be the 
), 1} set. Thus the parity of a pair or of a quad will be 
apy the sum of its elements modulo 2, and we shall 
ve a’ = a+ 1 (mod 2). 


eral Properties 
| 


1) The numbers of elements in two complementary 

ries are equal. If it were not so, the pair of extreme 

ments of the longest series ania remain unmatched 

ran unlike pair of elements with the same spacing in 
other series. 

2) Two complementary series are interchangeable. It 
ll be noted that this results from the symmetry of the 

finition with respect to the A and B series. 

3) The order of the elements of either or both of a pair 
complementary series may be reversed. This results 
m the circumstance that the order of a pair of elements 
es not affect the parity of this pair. 
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4) One or both of a pair of complementary series may 
be altered without affecting their complementary property. 
This results from the circumstance that the parity of a 
pair is invariant under alteration of both elements of 
that pair. 

5) Alternate elements in each of two complementary 
series may be altered, without affecting their comple- 
mentary property. Such a transformation results in the 
change of both or neither elements of an even spaced pair, 
so that the parity of such pairs remains unaffected. Con- 
versely, the parity of the odd spaced pairs is changed in 
both series, and this, by virtue of the remarks made in 2), 
does not affect the complementary property of the series. 

It is concluded from the properties 2)—5) that a single 
pair of complementary series can be the basis for the con- 
struction of 2° pairs of complementary series (some of 
which may be identical) by either performing or not per- 
forming the following six operations: 


a) Interchanging the series. 

b) Reversing the first series. 

c) Reversing the second series. 

d) Altering the first series. 

e) Altering the second series. 

f) Altering the elements of even order of each series. 


Examples 


The six individual operations listed above, when per- 
formed one at a time on the complementary series given 
above, yield the six new pairs of complementary series: 


00.0 Tol 0°. and™ 070,010 O06 


0 1:00 L 0.0, 0 Sand $0010 ei om 
0'0:0.1°0.0:1.0 -ande 1 0 19,156 010 
ey 101510 band. Ov 0 seer 
00010010 and 11100040 
OL1000111 ad 01001000. 


It will be noted that performing successively operations 
a)-e) on the original example will, in this particular case 
reproduce the original pair: 


0 O:0 AGT ie OTe and 02070 ai OrOs0 
1:0 t. 151 07020 wand ONO .0 FlsOr Osteo. 
OTe EAe0 000 wands Oets 070417 05020 
OASOFON0s tals sand Ome OsOcsOF080 
O07 0212 0L051-0) rand 30:0 0s1elgioOals 


It can be verified by inspection that no combination of 
the 6 operations listed above, with each operation per- 
formed at most once, and in the order listed, will reproduce 
the following complementary series: 


TO 202120 leO20c0ei sand O0r0"0r 0) 010 Teia0; 


S4 IRE TRANSACTIONS ON 


6) When the complementary property is written ex- 
plicitly for the two pairs which are n — 1 elements distant 
in the A and B series, we obtain 


aq ta,+o+5, = 1 (1) 


When the complementary property is written for the four 
pairs which are n — 2 elements distant, we obtain 


Hi ap eer et bate 


(mod. 2). 


+ b,-, + 6b, =0 (mod. 2), (2) 

and by addition modulo 2 of (1) and (2) 
Ao + Qn-1 + bo + 0,-1 = 1 (mod. 2). (3) 
The process may be continued to show that, generally 
Cit Gute ttty Orsct On ren eau leun (0022) 


When n 
yields 


2s + 1 andr = s + 1, substitution in (4) 


As+1 ae As+1 sr Oran a Be41 = 1 (mod. 2) 


which is self-contradictory. Hence, it is concluded that 
the number of elements in complementary series must be 
even. 


7) Let 


u(z, y) = (x — y)’, co OnmOUmmele Yas) OCmels 


the function of « and y thus defined is 0 or 1 depending 
upon the zy pair being even or odd. 
We shall have, for complementary series 


VIICR ieee OP err) aly (5) 
s=1 

that is, the total number of odd pairs of elements which 
are n — v elements distant in two complementary series is 
v. That is also, of course, the total number of even pairs of 
elements which are spaced likewise. 


Now let 
tv) = 4 NE, (Gr SO en She) = Bh 
Sts (Gea ee ee ee a) 
s=1 


The terms under each sum appear the same number 
of times as in the LHS of (5); and since there are v 1’s 
among them which must be associated each with a 0 to 
make v odd pairs, one half the excess of the 1’s included 
under the >> sign over v represents the number of pairs of 
1’s which are n — v elements distant. The last member of 
(6) may be utilized therefore to determine how many pairs 
of 1’s there should be with any given spacing, among two 
complementary series, and this reduces to approximately 
one quarter the number of pairs which must be examined 
in order to verify the complementary property of two 
series, 
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Example 
The two complementary series: 1000110110000010 and 


bottom, going up and then going down again, as follows: 


Lo 10982 et 
O70 OF oat 
LO O00 oat 
1,090TOR Se 
F050 Sle rom 
Oc OLORL gout 
OS on. 
10,020 43 


The numbers written at the right are the ¢(v)’s, and 
they are obtained in the reverse order by starting at 0 | 
and adding 1 every time a row containing three 1’s has 
been passed, going up and then going back down. It is 
immediately verified that there are four pairs of adjacent | 
l’s, three pairs of alternate L’s, etc., up to one pair of 1’s 
which are 14 elements distant. . 

8) Let p and q designate the numbers of 1’s in two. 
complementary series. Since the total number of even ' 
pairs in one must equal the total number of odd pairs in ™ 
the other, we have 


ep(p — |) -— 3G p) pe) eae) 
whence 
(7) 


z.e., the number of elements in complementary series must 
be expressible as a sum of at most two squares. Since this } 
number must also be even, the allowable numbers up to | 
50 are 


n=(n-p-—@g +(p-9q; 


2, 4, 8, 10, 16, 18, 20, 26, 32, 34, 36,40, and 50. 
GENERAL SYNTHESIS 
9) Consider the two series 
S; = AB = a) >> <sGh0y nos 
Ss = AB = 67200 e no (8) 


formed by appending the series A and B, and the series | 
A and B’. . 
It will be noted that the number of pairs of like a ele- 
ments with any given spacing in the first is equal to the 
number of pairs of unlike b’ elements with the same given 
spacing in the second, and that the number of pairs of 
like b elements with any given spacing in the first is equal ) 
to the number of pairs of unlike a elements with the same 
given spacing in the second. Furthermore, to any ab pair! 
of elements in the first corresponds the homologous unlike | 
ab’ pair of elements written immediately below in the 
second. This accounts for all pairs of elements in both S; | 
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id S, series, and it is concluded therefore that these 
ries are also complementary. 


10) It can be shown with a similar reasoning that the 
terleaved series 


as = a,b, a2b, cae ty a,b, 
ads. 
T, = aybja2b2 +++ a,b; (9) 
‘e also complementary. 
11) Let C = c, -:- c, and D = d, --- d,, designate 
10ther pair of complementary series, and consider the 
vO series 
i Ae ALP Btn ne 
ad 
OR a Ore aS acme re SS St (10) 


here the parity of the exponent determines whether the 
or B subseries is altered (odd exponent) or not (even 
<ponent). 

It will be noted first that the number of pairs of like 
ements with any given spacing within any A or B 
ibseries of the U, series is matched by the number of 
airs of unlike elements with the same spacing in the 
‘spective B or A subseries of the U, series. 

It will be noted next that any pair of elements, with any 
ven spacing, one taken in the A°’ subseries and the other 
1 the B”’ subseries, is matched by a homologous unlike 
air of elements with the same spacing one taken in the 
* subseries and the other in the B’ subseries. 

It will be noted next that all pairs of elements, one taken 

» subseries A‘°* and the other in subseries A‘‘** of 
ne U, series, can be matched with exactly as many unlike 
nirs of elements as are taken, one in subseries A“’ and 
1e other in subseries A*’** of the U, series. This 
slows immediately from the complementary character 
the C and D series. 
And last, the preceding observation will be made also 
yout the pairs of elements selected from different B 
ries. This exhausts the ensemble of the pairs of elements 
| the U, and U, series, and it is concluded that the U, 
ad Uz series are complementary. 

12) It can be shown with a similar reasoning that the 
iterleaved series 


] 


| Woes 
d 


A“?BY A“@B” ae, Act Ba 


aRB aecmAe BEA Be (11) 


ere the symbols of the RHS have the same connotations 
in (10), are also complementary series. 

It is concluded from 10), and also from 11), that, given 
70 pairs of complementary series of n and m elements, 
spectively, a pair of complementary series with 2nm 
ments can be synthesized therefrom. 


Va= 
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CoMPLEMENTARY SERIES IN WHICH 
n IS A POWER oF 2 


13) Let the generalized boolean sum b(a;, a;) be con- 
strained by 


b(0, 0) + b(0, 1) + b(, 0) + BI, 1) = 1 (mod. 2). (12) 


Let 2,4, --- x, designate the number x written in the 
binary system. Let 
€:(t) = D(te,, La.) + O(Gas, Las) + -*° 
+10, et) Ode) 
and 


€(%) =e(z) + 2,., (mod. 2) (13) 


where the subscripts a1, @, --* @, designate any permu- 
tation of the numbers 1, 2, --- e. It will be shown that the 
two series 


Ey, = e(0), e(1), iris €,(2°*) 


and 
Eige=="ex(O)s coh) ares a) 


are complementary. 

Let 2’ and y' designate two distinct numbers with the 
respective binits xj, 2, --: 2 and yj, y, °-- y;, and 
associate with xz’ and y’ the numbers x and y” formed by 
changing the binit preceding the first binit, in the order 
defined by a, a2, etc., which is different in x’ and y’. This 
association is clearly reciprocal and univocal, and we shall 
have always 


y—-x=y —-2 (14) 


since the change made in x' and y’ either adds or subtracts 
the same power of 2 to or from 2’ and y’. 

Consider now the pair of elements defined by 2’ and y' 
in the first series, and associate it with the pair of elements 
defined by x and y” in the second series. If 


aa cal hie 4s (15) 


there is no preceding binit which can be changed and we 
shall have 


2 1 
AUN > AG 


AY ts (16) 


From (13) and (15) we derive 


ex(x') + ex(y") + en(x”) + e2(y’) 


which indicates that the two pairs associated with each 
other are unlike for the case defined by (15). 

If on the other hand, the first binits which are different 
in v' and y' are the x.,, and y\,, binits 


iene EE Ue. etl (18) 


86 IRE TRANSACTIONS ON INFORMATION THEORY 


we shall have 


Bag SA yet (19) 
Radek a Megas a DMs — Piya (20) 
eee Ui SS Nea ee en en (21) 
= t= (22) 


The calculation of the parity of the z’y'a’y”’ quad needs 
involve only those elements which are formally different 
in e, and és: 


e,(x') abe e,(y’) ag eo(x’) ats e2(y") 
OP. 1 3,5 Tac) ot Ul tat hbas) at Uae ae) 
se Ghanem Yas) ae UGiee cae |) ar DG ae tee) 


TERE ROE ea OG Ey Ce hapr re se lis Be 1) 

The last two terms in the RHS of (23) cancel by virtue 
of (22). Furthermore, either the terms involving @;-» do not 
exist, when 7 = 2, or the first and third terms of the RHS 
cancel by virtue of (20) and (21), and so do the fifth and 
seventh terms. The remaining terms may be written, by 
virtue of (12), (18), (19) and (20). 


Dairy Vas) FOG ears Gar + 1) + b@., + 1, £2,) 


Ge... 1, ay ye Cod a2) ne 12) 

Thus it has been shown that every pair of elements of 
the first series can be associated with an unlike pair of 
elements in the second series which, by virtue of (14), 
have the same spacing; and that the association is univocal 
and reciprocal. This concludes the proof that the series, 
the individual elements of which are defined by (138), are 
complementary. 

14) Since the order of the a’s in (13) may be reversed 
without affecting the argument which follows, the two 


series 
E16 (Gah, Be.) 1-0 Ga wete) tee 
+ b@e.-1,%2.) (mod. 2) 
and 


e3(x) = e(x) + Xa, (25) 


are also complementary. 

15) The constraint (12) remains valid when b(2.;, Ya;) i8 
replaced by: O(t2i,-@uj) 0s Lac Oh O@si.te)) een 
b(Lai; Con at ae svete Gas. 

Therefore, e,(z) and e(«x), and also e,(x) and e%(a), 
remain pairs of complementary series when the sum 


Gps OM tore. 


Dy A,X; , 


is added modulo 2 to both e,(x) and e.(x), or both e,(2) 
and e%(«). 
The series formed by calculating the expression (26) 
modulo 2 for any sequence of numbers 0, 1 -:- 2° — 1, 
will be termed Walsh series by analogy with the Walsh 
functions which are obtained when 0 is replaced by —1 in 
these series, and the result obtained above may be stated 
as follows: 
The complementary series defined by (13), and also 
those defined by (26) retain their complementary property _ 
when they are added, element by element and modulo 2, to 
a Walsh series having the same number of elements. 
16) From the definition (13) may be derived the 
following construction, when passing from series with 2° 
elements to series with 2°** elements: | 
When two complementary series have been formed in 
accordance with (13), the first series with 2°** elements 
formed by interlacing the successive subseries of 2’ ele- 
ments into which the two complementary series with 2° 
elements may be divided, and the second series with 2°” 
elements formed by altering alternate subseries of 2 
elements in the first series with 2°** elements, are comple 
mentary series. 


CoMPLEMENTARY SERIES IN WHICH 
nIS NOT A POWER OF 2. 


= 10. Two basic pairs of complementary series exist 
for this case, from which all others may be derived by 
performing one or more of the six operations listed in 5) 
These two pairs of series are: 


? 


PO Oh OO 6 TK re 
10,050 50507.0 7 tla0 OF0 OFO MEO TOF TieO 
95673 10.74 IeSeor2 7103 Ge9 Pb Saless 
A relationship exists between these two pairs, which has 
been indicated by the numbers under them. Starting with | 
the seventh pair of symbols of the left pair of series, and | 
selecting every third pair of symbols thereafter, always 
recycling when the end of the series is reached, reproduces 
the successive pairs of symbols of the right pair of series. 
The left pair of series may be obtained similarly from the | 
right pair, as indicated by the numbers below the right 
pair of series. 
From these two basic pairs, complementary series vie 
10.2* .20° elements may be derived, utilizing the synthesis 
methods described earlier. 
n = 18. It has been verified by trial that complementary 
series do not exist forn = 18. 
= 26. An extensive, yet not exhaustive “longhand” ) 
search has not disclosed any complementary series for , 


this case. 
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CoNCLUSION 


When n is a power of 2, general methods have been 
‘termined, which lead to the formation of a large multi- 
icity of complementary series, albeit it has not been 
own that these methods constitute the most general 
ethods. 

When n is not a power of 2, complementary series have 
sen discovered for the basic case n = 10 only. They have 
sen verified not to exist for n = 18. 

The case n = 26 appears too laborious for an exhaustive 
nghand search. It is one purpose of this discussion to 
press the hope that someone interested in number or 
roup theory and having access to an electronic computer 
ill have the curiosity to program a computer to make an 
<haustive search for this case, and that if solutions are 
und, they may permit some generalizations, and the 


establishment of productive connections between these 
series and number or group theory. 

The next case for a nonpower of 2 is that of n = 34. 
Utilizing the complementary properties expressed by (4), 
and also the properties embodied in the,6 operations 
listed earlier, we may reduce the 68 choices of elements 
to = 34 — 6 = 45 binary choices. 

Thus 2*° combinations should be investigated, or a 
somewhat reduced number, if more elaborate properties, 
not discussed above, are utilized.* Even when so reduced, 
the numbers involved still appear formidable for an 
electronic computer. 

3 For instance, if complementary series are sought for n = 34, 
and if we set p = 13 and q = 16 in (7), the series with 13 1’s can 
be shown to consist of one series of 17 elements with 6 1’s inter- 
leaved with another series of 17 elements with 7 1’s; likewise, the 


series with 16 1’s can be shown to be the interleaving of 2 series 
with 6 and 10 1’s, respectively. 


Signal Detection by Adaptive Filters* 


E. M. GLASER}, MEMBER, IRE 


Summary—Communication engineers are now giving increased 
tention to detection systems which are able to adjust their own 
ructure so as to be optimum for the particular detection problem 
‘the moment. This paper describes a system which is capable of 
japting and optimizing its response to the class of pulse signals 
hose individual pulses are less than T seconds in duration. 

The analysis and synthesis of the adaptive system is facilitated 
y the use of an orthogonal function decomposition of the received 
gnal. The use of the orthogonal decomposition permits synthesis 
optimum linear filters by various circuit techniques, several of 
hich have been reported elsewhere. The structure of the system 
‘ilizing such a decomposition is described in detail. 

Since the operation of the adaptive filter is based upon signal 
tection and estimation in noise backgrounds, considerable at- 
ntion is devoted to the relationship between optimum signal 
tection and estimation. The methods of statistical decision theory 
ie used. 

A program to test the validity of the approximations and assess 
e over-all system performance was carried out by simulation of 
e system on both analog and digital computers. The results of 
ese experimental runs are described. 


* Received by the PGIT, June 2, 1960; revised manuscript 
eived, September 26, 1960. This research was supported by the 
AF through the Wright Air Dev. Div. of the Air Res. and Dev. 
mmand. 

+ Radiation Lab., The Johns Hopkins University, Baltimore Md. 


INTRODUCTION 


'( OST of the work in communication engineering 
| \ | concerning weak signal detection has been 
devoted to the study of the synthesis and per- 
formance of optimum, time invariant filters and detectors, 
that is, to detection systems whose structure is fixed in a 
configuration which is optimum for the particular signal 
or class of signals that is to be received [1]. In order to 
design a detection system of this class and expect it to 
yield any degree of satisfactory performance, the signal 
waveforms must be known (together with their statistics, 
if the waveforms vary), as must the statistical properties 
of the assumed stationary interfering noise. The designer’s 
restriction to an invariant system is one of the reasons for 
this being so. This fact is now well recognized, and in- 
creasing attention is being given to detection systems 
which are able to adapt their structure so as to be optimum 
for the particular detection problem of the moment. 
Examples of such systems are discussed in detail in [2] 
and [8]. These systems are restricted to the reception of a 
particular signal whose structure is known, but not its 
time of arrival, or epoch. The type of interference is 
known to be additive Gaussian noise of constant average 
power and slow multipath signal fading. 
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This paper describes a type of adaptive detection 
system suitable for the reception of a pulse signal whose 
waveform is fixed, but unknown at the receiver. The 
system is one which functions initially as an incoherent 
detector and, as it receives more and more pulses from a 
particular source, modifies its structure and optimizes its 
detection performance with respect to this signal. 


OptimuM DETECTION OF SIGNALS 
Vr1a Decision THEORY 


A substantial amount of the work performed in this 
report relies upon the ideas and theorems of matched 
filter theory’ and decision theory [4], [8]. Decision theory 
treats in a general way the problem relating to the detec- 
tion of signals in noise and the estimation of their struc- 
ture. The approach is based upon the fact that in testing 
hypotheses all decisions involve doubt and uncertainty 
and have associated with them various costs and risks. 
These may be measured in any way appropriate to the 
problem at hand. The cost is taken to be a function both 
of the true hypothesis and the hypothesis as the observer 
decides it to be. The conditional risk is the average value 
of the cost over all possible decisions the observer can 
make given a particular hypothesis. The average risk is 
the average of the conditional risk over all possible hypo- 
theses. Decision theory assumes that the observer wishes 
to behave in the way which will minimize his conditional 
or average risk. On this assumption, it shows the observer 
how to choose a decision rule for processing the received 
data. This decision rule will yield decisions which mini- 
mize risk for the particular physical situation and the 
costs involved. 

It is known from decision theory that a wide class 
(Bayes’) of tests for the optimum detection of signals in 
noise is based upon the use of the likelihood ratio A, 
given by 


Y(S)F(V |S) 


A= YOR 0) () 


The numerator of this ratio is the joint probability of data 
V and signal S$; the denominator is the joint probability 
of data V and the zero signal 0. 

Y is the a priori distribution of received signal S in a 
signal vector space 2. V is the received data vector in 
vector space I, and F is the conditional probability distri- 
bution of V given S. V is taken to be the sum of signal and 
noise N. A signal is said to be present whenever A exceeds 
some preset threshold level. The value of this threshold is 
dependent upon the test chosen and the various costs 
involved. Log A, a monotonically increasing function of 
A, is more convenient mathematically and physically to 
work with. The detection threshold for log A will be 
denoted by W. 


1See the Matched Filter issue of IRE Trans. on INFORMATION 
Tueory, vol. IT-6, June, 1960. In particular, the article by G. 
Turin, ‘‘An Introduction to Matched Filter Theory,” is useful. 


April 


It is convenient for our purposes to represent the 
received signal S(t) by an expansion of the form 


foe 


SQ = », 8,6;(2), (2) 
and the vector S = (s,, 8, --- , 8; °::). The ¢; are ortho 
normal on an interval which completely spans the interval 
(0, 7) in which all the S(¢) of interest are assumed to exist. 
We note here that we are interested in detecting single 
pulses received from a source which emits pulses of a 
constant shape,’ but not necessarily with constant repe- 
tition rate. The received pulses need not have the same- 
shape as the transmitted pulses. The set of ¢;(¢) which is 
of interest here is that which is a solution of the integral 
equation 


Te 
ii Ky(t, Wot) du = 04,2) O0< OW =F. 


J = ae, Be : 


The kernel Ky(¢, wu) is the autocorrelation function of the 
noise, N(t). N(t) can be expanded in the form >>? 
n,;(t). With this set of functions, H(n;n,) = 0 and 
E(n;) = o;, so that, for Gaussian statistics, the noises 
no; (t) and n,¢,(t) are statistically independent. 

There are two detection situations which are of par- 
ticular interest: 

1) Incoherent detection: The a priort probability of a 
nonzero signal is p, and the probability distribution of 
such a nonzero signal is uniform over Q. 

2) Coherent detection: The signal waveform is known 
to be exactly So. The a priori probability distribution of 
signals is then a Dirac delta function: Y(S) = 6(S — S,). 


Incoherent Detection 


In this situation it can be shown that when the noise is 
Gaussian, the log of the likelihood ratio A) is given by — 


Dv; 
o 


IS. 


log Aci) = log As” + 4 oO -, (4) 
7=1 1 


eS) 


with the constant term 


log Ac” = log» — >> log o, V2x (5) 
7=1 
and 
TE AL yay, (6) 
When o; = a, (4) can be reduced to 
T 
log Agi) = log aS? + al V(t) dt, (7) 
G Jo 
which is the well-known result that energy detection is | 


the optimum form of detection when signal structure is” 
unknown. 


? Pulses f:(¢) and f2(t) are of constant shape if fo(t) = kfi(t + 7). 
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The Bayes’ optimum quadratic cost function estimator 
or S is given by (8):° 


i SY(S)F(V | S) 
S* (8) 
i Y(S)F(V | S) dS 


Then Y is uniform, this can be reduced [5] to yield the 
yptimum estimators for the coefficients of S: 


=o = [ vosoa. 9) 


‘oherent Detection 


When the noise is Gaussian and signal §, is received, 
he log of the likelihood ratio A,.) is given by 


loge a= log Ag tL Sa , (10) 
7=1 i 
vith the constant term 
i) s. 
log Ag” = log u — 3 pe a (11) 
When o; = a, (10) can be rewritten as 
1 if 
Loew Se RlOr es tee Via(—f) dt ~—— (12) 
h(-t) = 2 Soi; (t). (13) 


Thus, (12) is seen to yield the familiar matched filter. 


Milter Systems for Incoherent and Coherent Detection 
It should be noted that both A,;, and A;,) are functions 
of time, so that (4) and (10) are more completely written as 


0; 


und 


log A..)(#) = log as? + ee “0 y,(0). (15) 

The incoherent and coherent likelihood ratio com- 
outers or detectors can be synthesized by means of time- 
nvariant linear filter systems. The linear filters have the 
mpulses responses ¢;(— ¢). In any real system there are 
ymnly a finite number of J of these, usually the first J of 
he set. It is also necessary to provide for epoch estima- 
ion, a means for determining when the likelihood ratio 
s at a maximum. This is easily done by differentiating 
og A and generating an epoch pulse whenever both 
1/dt log A passes through zero with negative slope and 
og A exceeds the detection threshold. Figs. 1 and 2 show 


3 See [4], Eq. (4.8). 
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block diagrams for the incoherent and coherent detection 
systems. The optimum component estimate outputs 
(obtained when log A is a maximum) are shown on these 
diagrams. Optimum estimates s*, for the coherent system 
are also found by (9). 


A Detection System for Gauss-Distributed Signals 


When the signals are Gaussian distributed a priori 
in signal space, it is possible to specify another Bayes’ 
optimum detector by use of (1). Suppose, in particular, 
that Y(S) can be written 


Y(S) = Yi(S1) Yo(Se) ete 


y; is Gaussian with mean E(s;) and variance D*(s;). The 
signal coefficients are then statistically independent of 
one another a priort. This assumpton is a cautious one 
and somewhat unrealistic, for there is likely to be con- 
siderable interdependence among the parameters. Never- 
theless, this type of distribution is a quile useful one to 
consider in connection with the process of adaptation to 
be discussed here. The likelihood ratio can be obtained 
via straightforward calculations and is given by* 


“ _ D(s;)ui(2) 
pe oj(o;.+ D*(s,)) 
E(s;)u; (0) 


yi(8;) ae) (16) 


log Acs)(é) = log Ao” + 4 


+ 2+ DG) se 
as (Gp = fi : 
log Ao = log LU ae a log Ee ais 2 | 
- E’ (s;) 
FLED) ue 


It can be seen that this likelihood ratio computer is a 
combination of the incoherent and coherent detectors 
discussed above. The optimum parameter estimator can 
be obtained from (8) and is 


- _ DXsiv; + E(s;)oj_ 
"a; DG) 


(19) 


This estimator weights the data input in proportion to the 
a priort signal component variance and the a@ priort 
expected value in proportion to the noise variance. Fig. 3 
is a block diagram of a detection and estimation system 
for signals having a Gauss a priori distribution. 


Tue ADAPTIVE FILTER 


It is now possible to describe an adaptive filter system 
for the detection and analysis of pulse signals. This 
system is designed for reception of pulse signals whose 
waveforms and amplitudes are fixed with time, but un- 
known a priori at the receiver. This amplitude restriction 
will be relaxed later in the paper. The system operates 
in such a way as to make the structural transition from 


4 See [5], Eq. (95). 
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its initial incoherent form to the final coherent form. It 
does this by utilizing its accumulated estimates of the 
incoming signal in a prescribed fashion which is optimum. 
It is optimum because at each stage of adaptation, 
assuming the a priori signal distributions are correct, the 
system is set up to compute the log likelihood ratio and 
the signal parameter estimates called for in the previous 
section 

The system operation can be outlined briefly. In the 
initial state the system is set up to receive in an optimum 
fashion any signal which may occur. All signals of duration 
less than 7 are assumed to be equally likely, and so the 
system initially takes the form of a square law detector 
followed by an integrator, (4) and (7). When a detection is 
made on the basis of the energy in the received data V(t), 
an estimate of the signal parameters, (9), is made and 
used to modify the system structure. The modification is 
in accordance with the assumption that the received 
signal arises from a set of signals whose components are 
distributed in signal space in a Gaussian fashion. The 
expected values of the signal components are taken to be 
the measured parameters, and the variances are the back- 
ground noise powers. The optimum system structure then 
must conform to that given in (17), resulting in a combi- 
nation of linear and square law operations on the linearly 
filtered components of the incoming data. It maintains 
this general structure throughout the succeeding steps 
of adaptation. The system now detects a second pulse of 
the signal, and re-estimates the parameters of the signal. 
The estimation is now performed according to (19), for 
the distribution of signal parameters is now taken to be 
Gaussian instead of uniform. The optimum estimate is a 
weighted sum of the expected value of the parameter and 
the magnitude of the data at the read-out time. The 
weights themselves are determined by the distribution 
variances. The new estimates are used to readjust the 
system, still assuming a Gaussian distribution of signal 
parameters with means given by the estimates and 
variances half that of the background noise powers. This 
process then continues on with the third detection and 
parameter estimation, system readjustment, etc. It can 
continue until a given number of steps of adaptation are 
taken, or until some criterion of goodness of adaptation 
is satisfied. 


Filter Operation and Structure, Fixed Amplitude Signals 


The regimen of operation of the adaptive filter system 
(Fig. 4) is as follows: 


1) At time ¢ = 0, the filter is in a configuration for 
incoherent signal reception. The a priorz distribution of 
signals in Q is taken to be uniform, and only p, qg and d, 
the expected duty ratio, are assumed known. The actual 
received signal, however, is So. The J orthogonal filters 
have impulse responses ¢;(— ¢). Their outputs are squared 
and summed to yield the logarithm of the likelihood ratio 
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April 


log A* for detection of the first pulse. A* denotes the 
likelihood ratio computed by the system in its mth 
adaptive step. The detection threshold is set at W,. The 
magnitude of W, is determined by the decision costs. The 
constant u, = pd/l-pd and is part of log Act [see (5)]% 

2) At t = t, log A* exceeds W, and attains some 
maximum value. At this instant, the optimum estimates 
s*/o; are read out, stored and applied, via the multipliers, 
as filter gains to the filter outputs v;/o;. The constant m4, 
is now adjusted to 


d/2 


= T= gp? (20) 


expressing a revaluation of the a priort probability from 
p to 1/2. The a priori distribution of signal is also altered 
from the uniform distribution to a Gauss distribution with 
mean H(s;) = s* for coefficient s; and variance D*(s;) = o;. 
All coefficients are taken to be statistically independent. - 
With this new a priorz distribution, the system is modified 
in accordance with (17) to compute 


CAG) J sky. 
log AX(b) = log Age + i ee =F 7 S, ne) (21) 
with 
d/2 ) J, A sh 
aes _ 2OV Ss Se a 
log A% = log € ap 5 log 2 — 4 x z (22) 


A new threshold W, is set automatically, again as a func- 
tion of the decision costs involved. The system now has 
both incoherent and coherent contributions to log A%, the 
coherent output being weighted in accordance with the 
magnitude of the previous component estimates. 

3) With the system operating as described above, a 
second pulse is detected at ¢ = ¢t, when log A*% reaches a 
maximum greater than W*. The estimates s/o; are read 
out, stored and applied as gains to the filter outputs. The 
estimators s% are obtained from (19). 


eS 
a 
~ 
to 
wa 
~n 
%* 


Sees ee ta ae (23) ” 


2 
The constant pw, is adjusted to us = (2d/3)/1 — 2d/3) 

as the a priorz signal probability is now taken to be 2/3. 
A third threshold W; is set on log A%. A new computation 
is set up for log A%. It is obtained by taking as the a priori — 
signal distribution one which is again Gaussian, with 
E(s;) = s% and D*(s;) = D?(s%) = 3 o?, from (23). The 
signal coefficients are again assumed statistically in- 
dependent. Then, referring to (17), | 


7 ult Le pe 
log A%() = log Aés + a in 2 Ss aoee (24) 
and 
2d/3 Ab J. gt? 
log At = log (— 2B) > log? — 4 ye (25) 
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) At t = ts, a third pulse is detected and the process 
cribed above is repeated. The optimum coordinate 
mator for the third pulse is, by means of (19), 


(26) 


) This process continues on as long as desired. For the 
1 reception, the log A* computation is 


ay i) 
Bea lop Ae, ee SD 


2 sen; 
m — 1 8% ma Oi . 
$ MoE yy Se 97) 
(m — 1) d/m | ui ( — 1) 
* = . — 
sin = log F — (m — 1) d/m 3 Hee m 
m =~ 1 - oe 
2m 2 G; Ce) 
1 
Sin m + m Sain) 
i ™ 
= an 2d v;(t,). (29) 
s easy to see that as m becomes infinite, 
l.i.m. s*, = 80; (30) 
l, as a result, 
d J ee 
4h = aa i O7 
m. log A*(t) log f ne ,) 2 > a 
J 
t+ ote. ay 


is is identical to (15) when up = d/(1 — a), so that the 
cess of adaptation described results in the system 
verging to the configuration of a filter matched to the 
eived signal Sp. 


cussion of the Adaptive Process 


‘he description of the adaptive process and derivation 
she functions log A* and s*, have been carried out on 

assumption that there is no error involved in esti- 
ting the epoch of the pulses. This, of course, is not true. 
tead of log A* reaching its maximum at ¢ = 1,,, which 
vould if there were no noise, the maximum is actually 
ched at time ¢*. As a result, the signal estimates 
¢*) have two sources of error, the noise amplitude at 
nd the epoch error eé,, = t, — t*. The statistics of the 
er error are quite difficult to obtain, but are a func- 
1 of the shape of the signal and its signal-to-noise ratio 
le those of the former are Gaussian and constant for 
‘ionary Gauss noise. For weak signals, the component 
mates will tend to be large and induce erratic behavior 
the adaptive system. It appears that there may be a 


minimum signal strength which the system can adapt to, 
and this also may be a function of signal waveform. 
Signals above this minimum will be successfully adapted 
to, and at a rate which decreases as signal strength in- 
creases. No calculations of this minimum ‘adaptable’ 
signal have been made. During the reception of a signal 
of this type, as the number of pulses received increase, 
and coherent operation is approached, the epoch estimate 
errors will decrease. The optimum estimator which has 
the form given by (29), for no epoch estimation error, will 
have instead the form 

(32) 


Yee 
Si 


az, av; (0%) ] 


where 


That is, the recent estimates will be weighted more 
heavily than the more remote ones. The weighting param- 
eters will be a function of the signal waveform. Since these 
are unknown initially, they could only be obtained by 
another process of estimation relying upon the preceding 
estimates. 

The detection thresholds W,, are functions of the costs of 
decision errors, as mentioned previously. One convenient 
choice of chreshold is that which maintains a fixed false 
alarm rate. The threshold is then calculated from the 
statistics of the background noise. Such a calculation is 
simple for either the incoherent or coherent detector, for 
in these cases the statistics are either chi-square or 
Gaussian. For the intermediate case where the noise is a 
combination of the two, (27) with m > 1, no tables exist. 
The threshold setting on log A* is dependent upon the 
signal parameter estimates. The exact form of the de- 
pendency has not yet been obtained. Approximation 
techniques must be resorted to.’ As a result, no rates of 
occurrence of false alarms have been calculated. 


Filter Structure and Operation, Variable Amplitude Signals 


The adaptive process as described above is adequate 
for the reception of an unknown signal of fixed shape and 
amplitude. If the amplitude of the signal fluctuates 
while the shape remains constant, the adaptive process 
described ahove is still applicable, provided the signal 
estimates are reduced to a normalized form §;,,,, before 
being applied as filter gains §,,,,/0; to the outputs of the 
orthogonal filters. We have here 
SE ml G3 


The purpose involved in using the normalized estimates 
is to eliminate the effects of the amplitude fluctuations in 
the signal and to simplify somewhat the design of a work- 


5 Tbid., ch. V. 
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Fig. 5—Normalized adaptive filter system for detecting pulse signals with fluctuating amplitudes. 


able adaptive filter. The structure of an adaptive filter 
using normalized component estimates is shown in Fig. 5. 

It is to be pointed out here that this filter is no longer 
optimum either for detecting signals of fixed or fluctuating 
amplitudes. In the former case, Park [6] has discussed the 
structure of an optimum system which estimates the 
normalized components directly, rather than normalizing 
the estimates as is done here. In the latter, fluctuating- 
signal situation, design of an optimum system requires 
knowledge of the statistical nature of the signal fluctua- 
tions. 

Signal detection and epoch estimation is now based upon 
the quantity log A,,, the log of the likelihood ratio for 
normalized estimation. This is given by a slight modifi- 
cation of (27) and (28): 


J 


De 


v;(2) 


2 
0; 


log A(t) = log Aom + = 


Ms F 1 = $5 m—-;(b) 
loa a (34) 
[ ie = t) a 
4 | m J m— 1 
log Aom = log rms log 
F C=aip 
m = 
= m— i z. (Fass) 
me 2 sake (35) 


This last expression can be simplified by noting that th 
summation in the last term on the right-hand side is one 
identically. Then 


log Age =" oe 


m 


There is some simplification found in the use of log 
K,,(t) instead of log A*(t), for the bias term log Ag,, is 
constant independent of the estimates of the receiver 
signal. The functional form of the fluctuating componen 
is, however, a function of S,,_, and quite difficult 
derive. | 

The probability density functions for the normalizec 
estimates are quite complicated. When the signal-to-noisi 
ratio is large, Park® has found that 


Sitmee a5 Sni/ Oi 
Bl )* Te ea) 1/2 (37 
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6 See [6], ch. IV, sect. D. 
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re s,; is the normalized jth component of the received 
al. Then it is true that 


: Si it Sa 
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om this, (84), and (35) it can be seen that 


CG; = 


m. log A,,(t) 


1 7 s,;0;(8) 
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us, when the signal-to-noise ratio is large enough for 

’) and (38) to apply, the adaptive system for reception 

an amplitude fluctuating signal will converge to a filter 

ich is matched to a signal whose components are 


IVC. 


slog 


SYNTHESIS oF AN ADAPTIVE SYSTEM 
(N oRMALIZED) 


An attempt was made to synthesize an adaptive system 
means of an analog computer installation. The back- 
yund noise was white, and the orthogonal filters were 
osen to be the Laguerre functions. The system was 
signed to work in real time. Considerable difficulties 
re encountered in achieving satisfactory results, owing 
inly to deficiencies in the available analog computer 
uipment. A description of the system is given in Chapter 
of [5]. 

The unsatisfactory performance of the analog computer 
simulating the adaptive filter during experimental 
ts led to the investigation of methods of simulating 
» adaptive system with a general purpose digital com- 
ter. It was found that such a simulation was quite 
sible when the computer was used to represent not 
ly the filter system, but also the signal source and the 
erfering noise. This type of simulation is somewhat 
re abstract than that performed by the analog com- 
ter, in that there is no use of physical signal or noise 
irces, or of electrical filter networks. Only the math- 
atical properties of the sources and filters are used. 
30, the experiment no longer takes place in real time, 
ce the generation in the computer of signal and noise 
cesses is required to await the completion of previous 
tection and estimation computations. There is, however, 
reat advantage in using the digital computer. The per- 
mance of the computer is known exactly, so that all 
cts observed are due only to the mathematical proper- 
s of the adaptive system and not to the form of its 
ysical realization. There is never confusion as to whether 
observed effect is an inherent result of the adaptive 
cess or of a defect in the hardware used in the 
ithesis. 


It is desirable to make some changes in the actual 
system to be synthesized when a digital computer is used 
instead of an analog computer. These changes involve 
primarily the use of a different set of orthogonal filters to 
represent the signal and noise processes. In the analog 
computer, Laguerre functions are easy to employ; in the 
digital computer, where a sampled-data type of operaton 
occurs, the cardinal functions [(sin x)/z] are appropriate. 
To be more precise, the digital computer can generate 
samples of the signal and noise processes at discrete points 
in time, and can only perform calculations based on these 
discrete samples. It is convenient to assume that the 
signal-plus-noise samples are spaced equally in time, with 
a separation of 7, seconds. Then if the noise is white, and 
bandwidth limited to the frequency interval (— 1/27, 
1/27), the autocorrelation function of the noise is 


- _ qr Sin 2rf(t =) me 
KE) = Ni ENC ar ae where fy = one (41) 
and the integral equation (37) becomes 

- sin Qrfo(t aay u) = 2 
fe ay 010) du = otal). (42) 


This is satisfied by the set of cardinal functions defined by 


sin Qrfo(t as Tio) 


Datel = 970) = 


¢;() = 7 = Opel; 2) ae 

The ¢,(é) are orthogonal over the interval (—, o). 

The characteristic values of the integral equation are 

equal and given by oj = No = N/2fo, the average per cps. 
The noise N(¢) can now be written as 


sin 2rfo(t — jro) 
Det a 


N® = Dn, 


j=—-o 


(44) 


and 


MG) = (45) 
The values of N(¢) at the sampling instants jz) are the 
coefficients of the cardinal functions in the orthogonal 
expansion of V(t), (— ~ <t< ©). 

In any data processing task involving a digital computer 
we do not have sufficient capacity to permit storage of 
data taken an infinite time ago. Consequently, we are 
interested in a system which stores only the most recent 
M sample values. From (45), it can be seen that a sequence 
of M samples of the noise taken 7) seconds apart is 
equivalent to the outputs of M cardinal function filters. 
If the past 12 — 1 samples are stored and processed 
together with the current sample, we have a filter system 
which is a member of the class of filter systems discussed 
previously. The system operation of processing the M 
most-recent samples simultaneously can also be seen to be 
similar to the filter system of Fig. 5, when ¢, is a cardinal 
function filter, ¢. is replaced by a 7) second delay line in 
cascade with another ¢, cardinal function filter, and ¢; is 
replaced by a jr» second delay line in cascade with a ¢, 
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filter. The system modification is illustrated in Fig. 6. 
The fact that the cardinal functions cannot be synthesized 
exactly is not important, since the filter output is what is 
of importance, and this is obtained by the sampling 
procedure. 

There is a difference between the actual sampling 
process and the extraction of orthogonal coefficients by 
means of the system of Fig. 6. The sampling process 
will yield values for the logarithm of the likelihood 
ratio only at the times corresponding to the sampling 
times. No continuous computation of log A can be per- 
formed. Consequently, the optimum read-out time is 
constrained to be at one of the sampling times, and some 
loss is found in the performance of the sampled-data 
adaptive system which does not occur in the continuous 
data processing system. This loss, though not determined, 
would not seriously degrade the performance of the 
system. The reason is that for a short duration signal, 
where epoch error is most important, the signal amplitude 
must be high for initial detection. Consequently, little 
error will occur in the initial parameter estimation, and 
this will decrease with subsequent estimates. For relatively 
long duration signals, the log of the likelihood ratio will 
tend to have a broad maximum. Epoch estimation errors 
in this situation will, therefore, not cause great errors in 
the waveform estimates. Nevertheless, the adaptive 
mechanism in both systems is the same. 


The Simulation Program 


The UNIVAC scientific digital computer at The Johns 
Hopkins University, Applied Physics Laboratory, was 
employed in this simulation study. The entire program 
was written in APT (Automatic Program Translator) 
Code. 

1) Number of Samples (M): The number of signal-plus- 
noise samples (corresponding to the orthogonal com- 
ponents) was chosen arbitrarily to be 10. For the particular 
signal chosen (see below), this guarantees that the signal 
can be represented without error by this set of orthogonal 
components, and that, in the limit, the system will adapt 
to the signal exactly. In the more general situation, the 
set of orthogonal components used to represent the signal, 
(2) and (3), and the number of their corresponding filters 
employed in the system synthesis are vital to the speed of 
convergence of the adaptive system to the received signal. 
For signals of equal energy, adaptation will be most rapid 
for those whose waveforms are most closely approximated 
by the set of filters in use. 

2) Szgnal: The only signal pulse used in this program 
was a square wave which was represented in sampled data 
form by a sequence of 5 samples of equal magnitude. The 
duty ratio was taken to be 0.05 so that there were 95 
consecutive samples of pure noise followed by 5 of signal 
plus noise. 

3) Noise: The noise samples had zero mean and unit 
variance. They were obtained from a computer sub- 
routine which consisted of the generation and addition of 


Fig. 6—An orthogonal filter system using cardinal functions (sé 
Fig. 5). 


twelve random numbers uniformly distributed betwee 
0 and 1, subtraction of the constant 6 and division b 
twelve. The sum so obtained is very nearly Gaussia 

4) Filter Operations: The filter operations of squaring 
summing, amplitude comparison, and estimate normal 
zation were performed substantially as in the analo 
computation. Detection thresholds were the same a 
before. The optimum read-out time computation wa 
somewhat different. Here, the current value of log A,, wa 
computed and stored if it exceeded both the amplitud 
comparison threshold and the previous high value of lo 
A,,. Also stored temporarily were the ten sample value 
of the input which produced this value of log A,,. A runnin 
count was made of the number of samples taken from th 
time log A,, first exceeded the amplitude threshold. Whe 
this count reached twenty, the temporarily-stored samp! 
values were transferred to the signal estimate accumu 
lators, and the log A,, address was cleared to zero. Detec 
tion thresholds were changed at the end of every detectior 
as was the mixing ratio for coherent and incoherent filte 
outputs. To prevent the computer from running for ex 
cessively long times without a successful detection, 
count was kept of the number of signal pulses generate 
during each run. A run was terminated after 20 signé 
pulses were generated, whether or not there were 10 signé 
(or noise) pulse detections. 

5) Tests: Ten detection runs were made at each of fou 
values of signal-to-noise ratio. Each run consisted of 
sequence of ten detections. The signal-to-noise ratios wel 
calculated from the definition 


Sine signal pulse energy 
° av. noise power/eps 


The signal pulse energy is 5S’r, where S is the magnitud 


7 See [7], pp. 244-245. 


ach of the five signal samples and 7, is the sampling 
erval. The average noise power is | and the noise band- 
th is 1/7). Then, 


5S? 7 


To 


SiN = =o. (46) 
ie values of S/N, tested were 100, 25, 16, and 9. The 
responding db values for S/N, were 20, 14, 12, and 9.5. 
0) Test Results: The data obtained from the detection 
s at each particular signal-to-noise ratio were processed 
yield: 


a) average values of signal component estimates; 

) estimates of the variances of the signal component 
estimates; 

c) the fraction of the estimated signal-waveform energy 

contained in those estimate components correspond- 

ing to the nonzero signal-waveform components. 


These data are shown plotted in Figs. 7-9. Smooth 
rves have been drawn to fit these points, the assump- 
mn being that if sufficient runs had been taken, the 
perimental points would fall very close to these curves. 
For the runs made at S/N, = 9, only two were com- 
ated (ten detections) before 20 signal pulses had been 
unsmitted. (The results for these runs are inadequate 
d are not shown here.) Nine detection runs were com- 
sted at S/N, = 16 and at the higher values of S/N, all 
‘re completed. 

The average of the signal component estimates and 
eir variances included all the component estimates 
gether since the individual nonzero signal components 
re chosen to be equal. This procedure washes out the 
ects of the estimation process on the estimates of the 
dividual signal components. However, from the data 
tained, there did not appear to be a significant variation 
the average of the estimates of the individual com- 
nents or in their variances. An investigation of effects 
the individual component estimates would have been 
re appropriate if the amount of data taken had been 
ich greater. As it was, the data taken were adequate to 
veal only the grosser aspects of the adaptive process. 


scussion of Results 


The value for each normalized signal component is 
1/5 = 0.447. It can be seen that the average com- 
nent estimates started low for all S/N, values and 
proached this value as the number of detections in- 
sased. In the weaker signal situations, both the initial 
d final estimates are poorer (lower). The five final 
mponent estimates corresponding to the nonzero signal 
mponents contain over 90 per cent of the total estimated 
ergy for all S/N > 16. 

In Table I are shown the per unit error in the 
erage value of the signal component estimates, the 
imate variances, and the per unit energy content of the 
e nonzero components of the estimated signal, all at 
> end of the adaption process. 
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Fig. 7—Adaptive filter digital simulation results. 
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Fig. 8—Adaptive filter digital simulation results. 
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Fig. 9—Adaptive filter digital simulation results. 


TABLE I 
S/No 
16 25 100 
Average Estimate Error —0.07 —0.03 —OnOs 
Variance of Estimate 0.014 0.007 0.0015 
Energy Content of Non- 
zero Components 0.94 0.97 0.992 
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rom the table it may be seen that the estimate 
variances increase almost in inverse proportion to S/No, 
and in direct proportion to noise power. This effect is to 
some extent predicted by (38) which can be rewritten as 
~ es 


m— 1 


D*(S¥,m—1 (47) 
That is, the variance of the unnormalized signal estimate 
is proportional to the noise power. The variance of the 
normalized signal estimate is more complex, as mentioned 
before, but tends to this result when the signal-to-noise 
ratio is large, which is the situation here. 

The average estimates are all consistently low through- 
out the tests, although they do tend to approach the true 
signal component values more quickly as S/N» increases. 
This effect was not predicted in the theoretical analysis, 
mainly because of the difficulties encountered in working 
with the estimators of normalized signal components. It 
is apparent, however, that when the signal consists of a 
group of equal nonzero components and another group of 
zero components, the average of the normalized estimates 
of the nonzero group must always be less than the true 
average of this group. As the magnitudes of the normal- 
ized estimates of the zero components of the signal 
decrease, the average of the estimates of the nonzero 
components will increase to the true average value. This 
is the situation which occurred in these tests. There were 
five equal nonzero signal components and five zero signal 
components. 

With regard to the concentration of energy of the 
estimated signal in the components corresponding to the 
nonzero signal components, it can be seen that the adap- 
tive system has substantially succeeded in recognizing the 
fact that five of the estimated components are zero or very 
small. Thus, although the component estimates are in 
error by 7 per cent or more for low values of S/No, a good 
degree of match has still been achieved. 

A more thorough study of the behavior of the system 
at low values of S/N, and for different signal shapes would 
have been desirable. This would have required setting 
higher detection thresholds to lower the false alarm rate 
and would have increased the required machine time. 


CoNCLUSIONS 


The results of the digital computer simulation demon- 
strate that system adaptation to the received signal wave- 
form takes place for signal-to-noise ratios as low as 16 
(12 db). Below this level, the amount of data obtained is 
insufficient to yield any significant conclusions concerning 
adaptation. It would appear that the adaptive system 
would perform satisfactorily at significantly lower values 
of signal-to-noise ratios, perhaps as low as 6 db, if the 


false alarm probability were decreased by several orders 
of magnitude. This would, of course, also decrease the 
probability of detection, but would still yield a system 
superior in detection performance to a nonadapting 
incoherent system. 

The statement asserting superiority of the adaptiy 
system to the incoherent system assumes, of course, the 
validity of the assumptions concerning the uniformity 0 
the a priori signal distribution, and the relatively sloy 
variations in received signal waveform from pulse ft 
pulse. It also assumes that the use of a small number of 
orthogonal components to represent the signal wave 
form will not result in a significant waveform appro . 
mation error. These assumptions have not been examined 
closely. As a result, questions remain open as to whethel 
the actual increase in signal detectability and the redue- 
tion in error rates of an adaptive system of this type 
justify the increase in the structural complexity of such 
a system over the more conventional invariant optimum 
systems. They can probably only be answered when ¢ 
quite specific problem in signal detection is considered. 

The present study has demonstrated that it is possible 
to design and construct a signal detection system whick 
is capable of adapting its structure to match that of an 
incoming signal. The usefulness of this type of system it 
various signal detection problems can be great. Detection 
and analysis of signals of unknown (a priorz) character 
istics is one possible application. Another is the tracking 
of known but slowly and randomly varying signals. 
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Lummary—We are concerned with the problem of designing 
efficient general method of coding two-level pictorial data. 
exact and approximate coding techniques are illustrated. 
pilot experiment is presented, in which a digital computer 
used to realize two-dimensional ‘‘predictive coding.’’ Although 
resulting compression was not great, there are reasons for 
eving that this procedure would be more successful with realistic 
rial data. 

urther experiments, which made use of approximation methods 
described. These methods arose from the application of pattern 
gnition theory to the present problem. Their use, either in- 
isa or prior to predictive coding, yielded compression 
ificantly greater than that attained by predictive coding alone. 


I. IntTRODUCTION 


E ARE INTERESTED in coding m-by-n 
matrices of black and white elements which 
represent pictures, maps, or other “meaningful” 
tterns. Since only those matrices having some definite 
ucture will be coded, we expect that binary codes sub- 
intially shorter than mn bits will be obtainable for each 
the patterns to be coded. A goal might be to take, say, 
0-by-500 matrices of black and white elements which 
present pictures and assign to them codes which average, 
y, less than 25,000 bits. Since we make the approxi- 
ation that the pictures to be considered are equiprobable, 
is would imply that there are no more than 2”°'°”° dif- 
‘ent meaningful pictures representable on a 500-by-500 
atrix. We describe first an exact coding process which has 
en performed by a computer and second our experiments 
th approximation methods, for which the additional 
ograms were not actually constructed, but only simu- 


ed. 


Ii. PrepictiveE Copine: An Exact Copineé PRoczEss 


A method’” of exact coding of pictorial data has been 
tained as an extension of the work of Elias*’* and of 
hreiber.’’® The method used is predictive coding, which 


* Received by the PGIT, June 23, 1960. The work reported 
‘e was done for Wright Air Dev. Div., Air Res. and Dey. Com- 
nd, under Air Force Contract No. AF 33(616)-5589. 

+ Melpar, Inc., Appl. Sci. Div., Watertown, Mass. 

1“Plight Display and Flight Control Integration,’’ Res. Dept., 
lbar, Inc., Watertown, Mass., AF 33(616)-5589; 1959. 

2R. E. Wernikoff, ‘On the Efficient Representation of Pictorial 
ta,” Appl. Sci. Div., Melpar, Inc., Watertown, Mass., Res. 
pt. No. 59/1; 1959. 

3 P, Elias, ‘Predictive Coding,’ Ph.D. dissertation, Harvard 
iv., Cambridge, Mass.; 1950. 

4P. Elias, ‘‘Predictive coding,’ IRE Trans. on INFORMATION 
Eory, vol. IT-1, pp. 16-383; March, 1955. a 

5 W. F. Schreiber, ‘Probability Distributions of Television 
nals,’ Ph.D. dissertation, Harvard Univ., Cambridge, Mass.; 
52 


2. a 
6 W. F. Schreiber, “The measurement of third-order probability 
tributions of television signals,’ IRE Trans. on INFORMATION 
rory, vol. IT-2, pp. 94-105; September, 1956. 
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involves the following steps (the first two of which are 
thought of as steps in a learning process, rather than as 
part of the predictive coding process itself): 


1) A survey of pictures representative of the class to 
be coded in any particular application is made to de- 
termine the relative frequency with which each of the 
possible ‘‘neighborhood” patterns X is followed by a 
black element. A neighborhood of a matrix element y is 
some convenient selection (based on available storage 
and number of pictures surveyed) of the elements which 
precede y in the matrix, when the matrix is scanned in 
some standard fashion, e.g., left to right, from top to 
bottom. Since we are concerned with a matrix rather than 
a sequence, a two-dimensional neighborhood is indicated 
as the best choice in general. 

In the experiments’ so far performed, a twelve-element 
neighborhood X was used: 


NGN GS he OA OOK 
Xs X, Xs X_g X10 
Xi, Xp ¥- 


Statistics were gathered on the number of times each of 
the 2”* different neighborhoods of black and white elements 
was followed by y = B and the number of times by y = W. 


Examples: 
Be As ee 
Wa Wsrm Vee jer joy Is) 
W W -Y. 


A white element would usually occur in the y position, 
following thzs neighborhood. 


WWBWW 
b WWBWW 
WW y. 


A black element would usually occur in the y position, 
following this neighborhood. 

A Datatron 205 computer required about thirty 
minutes to compile neighborhood statistics for 7000- 
element matrices. 

2) For each of the different neighborhoods, a unique 
prediction y is determined as the color which is most 
likely to follow the neighborhood (on the basis of the 
statistical survey). We thus obtain a “prediction func- 
tion,’ a table in which each of the possible neighborhoods 
“predicts” (z.e., is paired with) the color of y which is 
most likely to follow it. 


LOO 
Hxamples: 


[Seems Ro. Je) 


WW y 


3) Now each matrix representing a picture is paired 
(in a one-to-one fashion) with an “error matrix’ which 
indicates the elements y of the picture matrix for which 
the prediction function gives an incorrect value. In order 
to make possible a uniform prediction procedure, the 
picture is treated as if it were surrounded by a white 
border two elements wide. Tor each element y in the 
picture matrix, the actual color of y is compared with the 
color predicted by the function above, on the basis of the 
neighborhood of y. If the colors are the same, then a 0 is 
stored in the corresponding position in the error matrix; 
otherwise a 1 is stored there. (The computer performed 
this operation also in about thirty minutes.) 

4) The error matrix (which under ideal conditions 
should contain a small percentage of 1’s) is now coded by 
some process like run-length coding (which gives the 
number of 0’s between successive pairs of 1’s). Elias* has 
shown that, assuming uncorrelated error terms, a run- 
length code can always be found which codes the error 
terms efficiently: the average compression coefficient 
(code length divided by the number of elements in the 
error matrix) will not be much greater than the entropy, 
or optimum compression coefficient, H (for a binary array 
of uncorrelated terms in which the probability of one of 
the symbolsisp, H = — [plog.p + (1 — p) log. (1 — p))). 

5) To reverse the process and obtain a picture from its 
code number, we first obtain the error matrix from the 
run-length code. Then, the output of the prediction func- 
tion for each successive element of a new picture matrix 
is compared with the corresponding element of the error 
matrix. The color predicted is entered in the new matrix 
if the corresponding element of the error matrix is a 0; 
if the corresponding element is a 1, the other color is 
entered. The completed matrix thus represents the desired 
picture. 


III. Resuuts or A PREDICTIVE CopING ExPERIMENT’ 


Our experiment was made on. weather maps, in view of 
military requirements for efficient storage and trans- 
mission of information of this type. Figures representing 
sets of isobars from ten maps were traced on 70-by-100 
matrices, an element of the matrix being counted as black 
if crossed by an isobar. Because of the jaggedness of the 
figures thus obtained, really spectacular results could not 
be expected from predictive coding. On the other hand, 
if the jaggedness is taken as representing the effects of 
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noise in a full-scale pictorial data processing system, lack 
of success can be considered an illustration of Graham’s' 
observation on the vulnerability of a predictive coding 
system (or indeed any exact coding system) to the effects 
of noise which is embedded in the original data. 

Error matrices were obtained for each of the mapg 
using a prediction function defined on the basis of ¢ 
statistical survey of the whole group of ten maps. Each oj 
the error matrices was then coded by run-length coding 
Figs. 1 and 2 are computer printouts of one of the mapg 
and the corresponding error matrix. The results for the 
group of ten maps are summarized in Table I. 

As was mentioned in Section II, 4), the optimum co 
pression coefficient for an uncorrelated array of zeros and 
ones, where the probability of a one is 5.5 per cent, is 
H = — [.055 log. .055 + .945 logs .945] = 0.31. 

The average compression obtained by predictive coding 
was thus rather unimpressive. Greater compression (7.é., 
a smaller average compression coefficient) is expected for 
the high-resolution data which might be required in a 
military or commercial display device, since the high 
resolution data would tend to be smoother and the pro- 
portion of errors, therefore, to be smaller. The following 
factors, on the other hand, will limit the compression 
obtainable by predictive coding: 


1) The effects of noise and other irregularities intro 
duced in representing the original (continuous) 
picture on a discrete matrix are limiting factors. 

2) The inefficiency resulting from coding almost in- 
distinguishable pictures with different (and there- 
fore, on the average, longer) code numbers is also a 
limiting factor. 

3) The ‘‘global” rather than local character of many of 
the constraints present in meaningful pictures limits 
the compression obtainable by predictive coding 
(Youngblood® argues that no coding scheme based. 
on local operations is likely to be successful). Pre- 
dictive coding will not take advantage of these 
“global” constraints, since the largest neighborhood 
that can profitably be considered (because of 
memory limitations) is not much larger than the 
twelve-element one which has been described. 

4) Even supposing that, for 500-by-500 matrices, 
errors could be kept down to 2 per cent, an average 
code length shorter than 35,000 bits could not be 
achieved (35,000 = 250,000H, where H = 
—[.02 log, .02 + .98 log, .98] = 0.14). 

5) If letters, numbers, and other fine detail were 
added to the picture, code lengths would be tre- 
mendously increased, although there must obviously 
be an efficient way to code alphanumeric and other 
familiar data efficiently. 


7R, EK. Graham, “Communication theory applied to television 
coding,’ Acta Electrenica, vol. 2, 1-2, pp. 333-343; 1957-1958. 

’W. A. Youngblood, ‘Estimation of the Channel Capacity 
Required for Picture Transmission,’ Sc.D. dissertation, Mass. 
Inst. Tech. Res. Lab. of Electronics, Cambridge, Mass.; 1958. 
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x x x x x x ae =e x x 
x x x ord Peed x “28 as us x 
x oC x pod peoced x a 
x x x = pooed x ee 3 2 2S 
| x x x Pood poccced 3000 x ns x 
+t x Ss IGBGBGOECOEEEt— 388 IE * “s 23 as 
x x. = x 700K a: x z a 
xx Ke x yo0K x x = a x x x 
Bod ex x Es ES x x x x 
x so0000° x x x 
x x x x oO x Bord x x 
x x = x peed % x x x x 
ee: = x = 380 q88800t Bas 
x =x x x pod 0000 .0000C x = 2s zs = 
x x x x soo xx x x x pod x x AS x 
x x x x x x x x x x x ah 
x bod x x x 10x x x x x x oan 
 .ocooxk x x x x x x pea x x 24 x 
x a = a seHeeeEr se 12t——_ ee0— 24 x x 
x ot xm xx 700 x peced x x x 
a x xx x x x x x  $ he x a 
x x xx x ore x x x x pre x 
ae = «(xr Bod mom x x x x x x 
3 ES “z = = = cee a a xx x = x x z x ‘ | 
"5000 x xx x x yOOOCoRC x x x 
x = x x x x x x x x x 
x =x x pod x x x x pod Po 4 pod pod x 
ae = x x x x Reed x ped max xX pod xX bod e 4 x 
x xx x xx x yooooceceanr Xx x x x x x: 
ae —. —* ae 30 x x x 
x x x x x x x x xX 
x x x xx x x Po'd 
x x pod x 300K =x x 
ms x s9ooDoD0cK x x = 4 x x OC x x 
x x x x x x x x x 
— + —t- 7OGRF ~ x x x 
x x x Kx Pood x 
x x x x x x x x 
x =. ¥ 4 x x bod 
x x x xx oot x x x x 
x x x peed x x 
Pa x RES | x x xxx 
Fig. 1. niga Ze 
TABLE I 
PREDICTIVE Copine RESULTS 
Compression coefficient 
Per cent black run-length code 
Map elements in Per cent 1’s in Length of run- ————_—_——_ 
Number picture matrix error matrix length code 7000 
iL OR2, 4.9 2,394 bits 0.34 
2 ileal 5.9 2,798 .40 
3 10.8 DO: 2,838 41 
4 10.9 5.9 2,728 .39 
5 9.0 4.6 2,240 .o2 
6 12.6 6.6 2,990 43 
7 Whos) Sf 2,698 .39 
8 11.4 5.2 2,989 onl 
9 9.5 4.8 2,422 BOD 
10 14.6 6.5 3,010 43 
Ave. NZ ORO 2,670 bits 0.38 


We therefore turn to coding methods which could, 
ther in conjunction with predictive coding or separately, 
cape the limitations on attainable compression which 
e inherent in exact coding of pictorial data. 


. APPLICATION OF PATTERN RECOGNITION TECHNIQUES 


Closely related to the present problem of coding 
ctorial data is the current work on pattern recognition 
- those interested in psychology and in artificial in- 
ligence. Their work is not restricted to use of the 


local properties of meaningful pictures, which properties 
(as mentioned above) do not seem a sufficient basis for a 
really efficient coding scheme. Meaningful patterns which, 


in a particular application, would be reacted to in the 


same way (either because they are not distinguishable by 
the observer or because, although distinguishable, they 
provide him with essentially the same information) might 
as well be considered one pattern and represented by a 
single code number. Pattern recognition schemes will be 
useful to us if they provide a means by which, for each 
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code number, there can be recovered a representative 
pattern (one of the equivalent patterns having that code 
number). Our problem is somewhat different from most 
pattern recognition situations, where each presented 
pattern has to be recognized as belonging to one of a small 
set of given categories. We are concerned with the 
“yractically infinite’? collection of meaningful patterns, 
which cannot be given in advance. 

In changing our goal from that of assigning short codes 
to meaningful pictures in a one-to-one manner, where a 
single change in the matrix representing a picture results 
in the picture’s being considered different and assigned a 
different code number, we at the same time 1) recognize 
and compensate for the possibility of noise in the original 
picture, and 2) reduce the total number of pictures that 
will be considered distinct, so that average code lengths 
can be reduced. If, for example, under some scheme of 
classification, only 2”°°° meaningful pictures representable 
on a 500-by-500 matrix are considered different, an 
average code length of 2500 bits can be aimed for. 

Minsky’’”’ feels that a solution of the pattern recog- 
nition problem can be obtained without resorting to the 
use of statistics. He speaks of a program which would 
isolate each figure in a picture, put the figure into standard 
form by translation and magnification, analyze the figure 
for the purpose of recognizing it (or, in our case, coding it), 
and finally give the geometrical interrelations of the 
figures which characterize the picture as a whole. The 
output of the program (for us) would be 1) a set of code 
numbers, from which each of the figures in the picture 
could be regenerated, and 2) another code number giving 
the geometrical relations among the figures. 

A first step in the analysis of particular figures can be 
based on the work of Selfridge’ ** and Dinneen.* 
Selfridge was interested in finding ways of reducing given 
patterns to coded versions thereof, picking out the 
significant features of a pattern in order to classify it. The 
corresponding computer operations that Dinneen used 
made possible the removal of small bits of noise and the 
selection of contour points (edge points of the figures in 
the picture) and, in particular, the points at which the 
contour has greatest curvature. 

Attneave has given us two schemes which look as if 
they should be very useful in coding pictorial data ef- 
ficiently. In the first,’ he points out a way of taking 
advantage of the fact that ‘‘information is concentrated 
along contours and is further concentrated at those points 


°M. L. Minsky, Lecture given at Mass. Inst. Tech., Cambridge, 
Mass.; 1958. 

10M. L. Minsky, “Heuristic Aspects of the Artificial Intelligence 
Problem,” Lincoln Lab., Mass. Inst. Tech., Lexington, Mass.; 1956. 

QO. G, Selfridge, “Pattern recognition and modern computers,” 
Proc. WJCC, Los Angeles, Calif., pp. 82-84; March 1-3, 1955. 

2 O. G. Selfridge, “Pattern recognition and learning,” presented 
at Symp. on Information Theory, London, Eng.; 1955. 

3 O. G. Selfridge, “Pandemonium: A Paradigm for Learning,” 
Lincoln Lab., Mass. Inst. Tech., Lexington, Mass., JA 1140; 1958. 

4G, P. Dinneen, ‘Programming pattern recognition,” Proc. 
WJCC, Los Angeles, Calif., pp. 94-100; March 1-3, 1955. 

16 F, Attneave, “Some informal aspects of visual perception,” 
Physchol. Rev., vol. 61, pp. 183-193; 1954. : 
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on a contour at which its direction changes most rapidly”; 
a good likeness of an object is obtainable by finding the 
points of high curvature on the boundary of the figure 
and replacing the curves connecting these points by 
straight line approximations. We have tried a procedure 
like this in conjunction with predictive coding (see Sec 
tion V, A). 

A second coding procedure, recommended by Attneave 
and Arnoult,’® has not yet been tested by us, but seems 
even more promising, since it provides curvilinear approxi 
mations to given figures. In this procedure, tangents are 
drawn to a figure at points of low curvature and at corner 
points. The angles in the resulting polygon are then 
rounded off, using certain standard arcs to approximate 
the given curves. Each figure is coded by specifying a 
starting point, changes in direction in degrees and changes 
in logarithm of length for the tangent lines forming the 
polygon, and amount of rounding off for each angle of 
the polygon. 

The recently reported work of Unger’’ on ‘edge 
sequences’ has proved to be quite useful for our purposes. 
The edge sequence, which gives essentially the directions 
(limited to 45°, 90°, , 360°) of the successive line 
segments which form the boundary of the figure under 
consideration, can be used as a first “‘character’’’® for 
classifying the figure. It can easily be seen that edge 
sequences will not always be enough to distinguish two 
figures, but they can be used to help detect similarities 
among the figures in the picture and the figures in the 
picture which may fall into one of a given (nonexhaustive). 
set of frequently used categories (e.g., individual letters, 
numerals, special map symbols). These categories can be 
given short code designations. A figure which is similar to 
another in the picture or in the gzven set can be coded by | 
specifying only its location, size, orientation, the number. 
of the figure it is similar to, and the corrections (additions 
or subtractions) which are necessary to change one 
figure into the other. 

An experiment combining Unger’s and Attneave’s 
ideas is described in Section V, B. 4 

Mention should be made, finally, of the work of Uhr,’® 
who reported to the 1959 ACM meeting on a program in’ 
progress which would have the computer “process forms 
according to a procedure that recognizes successively 
higher order relations between successively larger ele- 
ments, or subwholes, of a form.” His program recognizes 
relative and absolute sizes of lengths, loops, and angles, 
and can be so used that it makes distinctions only to the 
rather small degree that is within the abilities of the 
human observer (5 to 15 just-noticeable-differences along 


6 F. Attneave and M. D. Arnoult, “The quantitative study of 
etn and pattern perception,” Psychol. Bull., vol. 53, pp. 452-471; 


7S, H. Unger, “Pattern detection and recognition,” Proc. IRE, 
vol. 47, pp. 1737-1752; October, 1959. 

18 7,. Uhr, “Machine Perception of Printed and Handwritten 
Horne by ee of ete for Assessing and Recognizing Ges- 
alts,’ 14th Natl. Meeting of the Assn. for Computing Machi 
Cambridge, Mass.; 1959. E Oe eee 
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ch “dimension”: e.g., slope, length, average curvature). 
his program, or some combination of its operations with 
ose suggested by Attneave and Arnoult, should provide 
foundation for approximate coding methods even more 
ficient than those now to be described. 


V. Resutts or EXPERIMENTS 


. “Straight-Line’ Approximations and Predictive Coding 


Using one of the weather maps mentioned in Section 
I, Selfridge and Dinneen’s edging process (in which the 
adial asymmetry” about each black element is evalu- 
ed) was used to pick out the points of high curvature on 
e boundary of each figure on the map. Then, following 
nly) the spirit of Attneave’s suggestion (since straight- 
le approximation to the curves joining these points 
yuld have become rather broken lines in their matrix 
presentation), the curve joining each pair of these points 
high curvature was replaced by an approximation made 
) of a small number of horizontal, vertical, and diagonal 
ith slope + 45°) line segments. To connect the points 
2nd b, for example, broken lines of the following types 
re used. 


a a a 


none of these broken lines gave a close approximation to 
2 original curve joining the two points (such a failure 
ild have been detected mechanically), an intermediate 
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Fig. 4. 
TABLE II 
Compression 
coefficient 
Per cent 1’s | Length of run-length code 
in run-length —————— 
error matrix code 7000 
Map 1 4.9 2,394 bits 0.34 
Approximation 1.5 930 13 


point of the original curve was selected and joined to each 
of the originally chosen points by one of the three kinds of 
broken lines. The resulting map appears in Fig. 3. 

The predictive coding program (with twelve-element 
neighborhoods) was then applied quite successfully to the 
standardized map thus obtained. There is a striking 
difference between the original error matrix, which looked 
a great deal like the map itself, and the error matrix 
resulting from predictive coding applied to the standard- 
ized map (compare the print-outs in Figs. 2 and 4). 
Whereas run-length coding of the original error matrix 
had resulted in a code of length 2,394, from which the 
original map could be recovered, run-length coding of the 
error matrix corresponding to the standardized version 
of the map resulted in a code of length 930, from which 
only the standardized approximation to the original map 
can be recovered (Table II). 


B. “ Straight-Line”’ Approximations and Edge Sequences 


The standardized map obtained in the previous ex- 
periment could be coded, not by predictive coding, but 
by a more complex code specifying the location and 


104 IRE TRANSACTIONS ON 


description of each of the figures in the picture. Each 
figure (unless it could be recognized as belonging to one 
of the given categories, ¢.g., circle or ‘“A’’) would be coded 
by specifying the directions and lengths of the successive 
line segments which formed the figure. If a figure were 
“similar” to (7.e., had roughly the same shape as) another 
in the map or in a given category, that fact would be noted 
and used to predict both its edge sequence and the lengths 
of the edges. The fact that one figure was known to be 
similar to another would make a great deal of the direc- 
tion and length information redundant and _ therefore 
allow compression into a shorter code. 

A rough calculation of the code lengths necessary to 
reproduce essentially the standardized map of the previous 
section yielded the following estimate (which should be 
looked upon as an upper bound): 


1) To Specify Starting Points (or Centers, in the Case of 
Circles) for the Thirteen Figures in the Standardized Map of 
Fig. 3: Since most of the 13 points fall on the edges of the 
map, we could code them very efficiently by run-length 
coding if we ordered the 7000 elements of the matrix in 
the following way: 


1 aro eee =a OO) 
SIO" Soke eae oe aoe wml MON: 
7000. 
20S ea ae Osl OO: 


About 110 bits would be required. 

2) To Designate for Each Figure: a) to which of the 13 
figures it is similar (for this computation figures were 
considered similar if their edge sequences were similar; we 
allow, in particular, that a figure be similar only to itself) 
or b) to which of the given categories it belongs (‘circle” 
being the only category used here). About 13 X 4 =-52 
bits would be required (log, (13 +1) = 4). 

3) To Specify the Size (Radius) of Each of the Two 
“Circles”: about 2 X 4 = 8 bits, allowing the radius to 
have any one of (say) 16 possible lengths. (Note the great 
reduction possible when the figure falls into a given 
category. ) 

4) To Specify (Direction-of-) Edge Sequences for the 
Six “Similar” Figures (by Comparison of Edge Sequences, 
Fig. 5 is a similar to Fig. 6, 4 to 5, 3 to 4, 2 to 3, and 13 
to 2): About 60 bits for run-length coding of the error 
sequence resulting from use of predictive coding on the 
edge sequences, where predictions (+ 45° turns) would be 
made on the basis of the edge sequence of the pattern to 
which the pattern under consideration was similar (when 
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this could not be used, predictions would be made on the 
basis of previous curvature). 

5) To Specify (Length-of-) Edge Sequences for the St 
“Similar” Figures: About 3 bits/edge: about 165 bits 
(length of the corresponding segment, if there was one in 
the similar pattern, being used to get approximate length) 

6) To Specify (Direction-of-) Edge Sequences for the 
Five ‘““Nonsimilar” Figures: About 65 bits for the error 
sequence resulting from use of predictive coding on the 
edge sequence, predictions (+ 45° turns) being made (not 
very successfully) on the basis of continuation of the 
previous curvature. 

7) To Specify (Length-of-) Edge Sequences for the Five 
“Nonsimilar” Figures: About 4 bits/edge: about 125 bits. 


The code length would be, therefore, approximately 
110 + 52 + 8 + 60 + 165 + 65 + 125 = 585 bits} 
which represents a compression coefficient of 585/7000 
= 0.08. 

A computer coding pictorial data in the manner just 
outlined could even use the following operational definition 
of similarity. Fig. k is similar to Fig. / (or to the figures in 
category 1) if this designation of Fig. & in 2) yields a 
shorter code for that figure in 4) and 5) than would be 
obtained for that figure in 6) and 7). 


VI. ConcLUsION 


After discussion of an experiment in which predictive 
coding was performed by a computer, we moved away 
from the ideal of exact coding and reproduction of pictures 
in order to achieve more compression while still preserving 
the significant features of pictures, maps, etc. Using 
pattern recognition techniques, with or without sub- 
sequently resorting to predictive coding, we have taken 
account of large-scale features of pictures, avoiding sole 
reliance on local operations. The operations considered 
enable a computer to categorize pictures efficiently without 
its having been given a complete set of categories. 

Reductions in the compression coefficient (from 0.34 to 
0.13 or 0.08) point toward still greater savings to be 
realized through the use of pattern recognition methods 
when realistic high-resolution data is processed, since 
there it is clearly the general pattern that is important, 
and not the colors of particular matrix elements. 
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mmary—The necessary and sufficient (n. and s.) conditions 
he nonsingularity, i.e., regularity, and for the singularity of 
um tests for the presence of one Gaussian process vs another 
finite sample are established, for both nonstationary and 
onary processes, including those with nonrational spectra. 
e stationary cases, the condition may be expressed alternatively 
rms of an integral of suitable spectral ratios when the random 
esses possess rational spectra and for certain classes of non- 
nal spectra as well. Equivalently, for rational spectra the 
nd s. condition for nonsingularity is that the spectral ratio 
oach unity as frequency becomes infinite and that the spectral 
© be finite and nonzero for all frequencies, while for singularity 
n. and s. condition requires that this ratio differ from unity 
he limit or if unity in the limit, that this ratio vanish or be un- 
nded at some one (or more) finite frequencies. Some of the 
lications of these results in applications to signal detection are 
sidered, and a method of solution of an associated class of 
gral equations, of the type 


+ 

L(r, wWK(| u — ¢}) du = Git, 7), O - <t,7 < T+ 
sre K is a rational kernel and G is suitably specified, is briefly 
lined. Specific results in the case of RC and LRC noise kernels, 
h G correspondingly the difference of two (different) RC or LRC 


ariance functions, are also given. 


I. INTRODUCTION 


HE problem of detecting optimally the presence 

of a Gaussian signal in normal noise has been con- 

sidered by the author’? and a number of other 
estigators in recent years.’ The results are generally 
singular Bayes (7.e., minimum average risk) tests, 
t is, optimum statistical tests which yield nonzero and 
vunity probabilities of error, based on finite samples. 
wever, as Slepian* has more recently pointed out, 
imum singular tests, whereby perfect detection, 
bability 1, is possible with arbitrarily small samples, 
y arise in certain instances, where in effect the math- 
atical model is poorly chosen to represent the actual 
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physical circumstances.” ’ In the case of two different 
stationary Gaussian processes N,(t), N,(¢), with zero 
means and spectral intensity densities Wo(f), W.(f), 
respectively, Slepian gives some sufficient conditions for 
the singularity of such tests. The exceptional cases, about 
which his theorem makes no statement, occur when 
lim; W,(f)/Wo(f) = 1. The main purpose of the present 
paper is to state and to outline briefly the derivation of 
the necessary and sufficient (n. and s.) condition for the 
existence of the optimum nonsingular (Bayes) test of one 
Gaussian process N,(¢t) vs another N,(¢) for 1) general, 
nonstationary processes and 2) various classes of sta- 
tionary processes, where both N, and N, have zero means.” 
From this we obtain also the necessary and _ sufficient 
conditions for 1) and 2), that the optimum test N, vs No 
be singular, accounting in both instances as well for the 
important exceptional case in Slepian’s theorem.* Several 
comments on the implications of these results for physical 
applications complete our discussion. 


Il. Principat REsuuts 


In this section we summarize the principal results 
formally as a series of theorems and in Sections III-VI 
provide the details of the proofs. We begin by postulating 
that the random processes in question, No and N,, are 


1) normal, with zero means; 

2) possess covariance functions Ko, K, that are positive 
definite, symmetrical, continuous and quadratically 
integrable on an arbitrary observation nterval 


(=) Tey 


Then, we have the following theorems, subject to 
various additional assumptions on the processes No, N, 
such as stationarity, nonstationarity, spectral rationality 
and nonrationality. We consider first the general case: 


> U. Grenander, ‘Stochastic processes and statistical inference,” 
Arkiv. Math. vol. 1, p. 195; 1950. For a first example involving 
the case of normal noise vs normal noise, cf. Sect. 4. For an example 
in sequential detection, see. 

6 J. J. Bussgang and D. Middleton, “Optimum sequential de- 
tection of signals in noise,” IRE Trans. on INFORMATION THEORY, 
vol. IT-1, p. 5; December, 1955. 

7]. J. Good, “Effective sampling rates for signal detection: 
or can the Gaussian model be salvaged?”’ Information and Control, 
vol. 3, p. 116; June, 1960. For conditions governing the avoidance 
of singular situations in the information capacity of certain types of 
channels, in reply to Good’s work, see P. Swerling, ‘“‘Pardoxes re- 
lated to the rate of transmission of information,” Information and 
Control, vol. 3, p. 351; December, 1960. 

8 For nonvanishing means, our subsequent argument is simply 
modified without any essential changes in procedure. 
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Theorem l(a): The necessary and sufficient condition that 
. . r r lanl 
the optimum (Bayes) test of N, vs No on (O—, T+) be 
regular, t.e., nonsingular, is that 


T + 


=e A ae it Lin (t,t) dt 295 
1 0o- 


= 0 
=] 


(1) 


a= 
a= 


where the functions L,,(t, u) are the solutions of the in- 
homogeneous integral equations 


[ VIACOM AC Ue RAO Oe 


OS 0 eles (2) 


Here \<°” are the eigenvalues of the associated homogeneous 
integral equations 


T+ 
[ Lat, Woe) du = P49", OS TST. @) 
v0- 

Theorem 1(b): The necessary and sufficient condition 
that the optimum (Bayes) test of N, vs No on (0 —, T+) be 
singular, 7.e., yield perfect detection (probability 1) for all 
finite T > € = 0, ts that 

© T+ 
yx = i Lat, t) di diverges, (4) 
1 (ee 

We remark that the eigenvalues of (3) are not necessarily 
real, since Lay (t, 7) # L..(7, ¢) in general. We also observe 
that Theorems 1(a) and 1(b) apply for stationary as well 
as nonstationary normal processes, with either rational or 
nonrational spectra. 

In the stationary situations, we have the following 
alternative theorems, equivalent to Theorems 1(a) and 
1(b), but now expressed in terms of the respective spectral 
intensity densities of No, N,. We consider first the cases 
involving rational spectra, 7.e., spectra of the processes 
obtained by passing white (normal) noise through an 
invariant, stable, lumped-constant network: 

Theorem 2(a): If the normal processes No, N, are station- 
ary with rational spectra Wo, W,, the necessary and suf- 
ficient condition that the optimum (Bayes) test of N, vs No 
on (0 —, T+) be regular t.c., nonsingular, is that 


OR SAORS weld | 
ar | Ee wile | <% 


Sl Ore Tico (5a) 
or equivalently, that 
a Wilf) _ ys. Wolf) 
Tee Ames Se 
and that 
Wilf) Wolf) 
Passgn(f) tm (fy) ee ale ae 
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The equivalence of (5a) and (5b) follows at once from fk 
fact that for all rational spectra under the latter conditioi 
there can be no spectral “holes” in Wo, WW, over ar 
finite frequency interval, alternatively reflected in I 
fact that the covariance functions K., K, are positr 
definite (as opposed to positive semd-definite). . 

Theorem 2(b): The necessary and sufficient condition fi 
the singularity of the optimum (Bayes) test of N, vs No whei 
N,, No possess rational spectra W,, Wo respectively, vs th 
forall0O < T < & 


oT if : | 8 ss Seald | df diverges. (6a 


Wo(f) Wilf) 
This is equivalent to 
. Wilf) Wilf) _ 4 
ipa wolf) ~1, and/or wolf) ~ 0 (6b 


for some f(0 <f < @). 

(Note that it is possible to have lim;,. Wif/Wo(f) = 
and still have singularity, if W/W, vanishes or is ul 
bounded in 0 < f < o.) 

However, in many physical situations the noise mechani 
ism is in some sense represented by distributed sources 
so that the resulting spectrum is nonrational; clutter 
scatter multipath, noise generated in traveling-wav 
tubes are important examples. For some of these non 
rational cases we may state the following: 

Theorem 3: In the special cases for which the nonrationa 
spectra may be regarded as suitable limiting forms of ration: 
spectra, the necessary and sufficient condition’ for regularit 
or singularity of the optimum (Bayes) test of Ny vs No 2 
now that (5a) or (6a) apply, respectively. 

For the special class of nonrational spectra characterizec 
by bandlimiting, where No, Ni are bandlimited to th 
same (or different) spectral intervals, we have the follow 
ing theorem: 

Theorem 4: A sufficient condition that the optimum 
(Bayes) test of N, vs No on (0 —, T+) be singular zs tha 
N,, or No, or both N, and No, be bandlimited to the sam 
or different spectral regions. 

Note that bandlimiting is a sufficient, but not a neces 
sary condition for singularity, which may also occur fo: 
rational spectra, of Theorem 2(b) above. Theorem 4 i 
essentially Slepian’s result,* as is (6b) from the viewpoint 0 
sufficiency. Finally, we observe that for both the singula 
and regular cases in all instances the conditions (1), (4) 
(5a)—(6b) are qualitatively independent of interval length 
T, as long as this interval length is finite. Some of the 
implications of these results in applications are discussec 
in Section VII. 


* The nonrational cases are fully covered by Theorems 1(a) anc 
1(b). We were not, however, able here to demonstrate necessitt 
and sufficiency for the spectral form of these theorems in the genera 
nonrational situations, although on physical grounds we strongh 
suspect that (5a) and (6a) represent both necessary and sufficien 
conditions, respectively, for regularity and singularity in the case o 
spectra which are not bandlimited. 


HI. Tum Generar SrruatTion; PRoor or THEOREMS 
1(a) AND 1(b) 


e consider first the general situation described at the 
inning of Section II above, where no specific assump- 
s of stationarity, spectral rationality, etc. are neces- 
ily made. To establish the results embodied in Theorems 
) and 1(b) of (1), (4), we start with the discrete case 

sampled values V = [V,, Vo, --- , V,] of the received 
ess V(t) on (0, 7’). For the gauss processes postulated 
e, the optimum detector structure for the Bayes test 
, vs Ny is the generalized likelihood ratio.’° 


An = log pio — 4 log det K,Ky’ 
SNR ON eh) 


{Fe fio = P1/Po is the ratio of a priori probabilities that 
> sample V represents NV, or No, with po + p, = 1. Here 
, Ky are the n X n covariance matrices of N, and No 
times ¢ = ¢,, --: , t, in (0, 7), with the nonsingular 
verses K;', K;’. 

or the regularity of the test we must show with con- 
uous sampling on (0 —, 7+) that the logarithm of the 
elihood ratio functional log Ar = lim,.. log A, is 
unded and approaches a different unique value with 
spect to each hypothesis Hy ¢ No, Hi e N,, and that the 
aditional error probabilities 8}”, 6{° of deciding No 
1en N, is actually present, and vice versa, are neither 
-o not unity, 7.e., that in the limit n > ~, 0 < ,%”, 
» < 1forall0 < T < o. The necessary and sufficient 
adition for this is established from the demonstration 
elf, as will be noted presently. 

Accordingly, we must show that 

co < lim Eyjz,{V(Ki' — Ky')V} < , 


noo 


a 


C= 071, (8a) 


d that 
37 | = | lim {log pio — 4 log det K,Ky"} | < @. 


no 


(8b) 


xt, we observe that log Az, cf. (7) in the limit, may 
ntain either a positive definite, or a negative definite 
adratic functional of V(¢), or a quadratic functional of 
t) that is neither positive nor negative definite. The 
tribution densities (d.d.’s) P: (x), Po(x) of the functional 
= log Ar with respect to H,, H» accordingly vanish for 
peg 0 <6, of tor all 4 > 2%, 2 > Wo, respectively 
x contains a positive or negative definite quadratic 
ictional, where 2, x, are appropriate limits for the 
ge of values of the random variable x = log A, in the 
o hypothesis cases H,, H,. However, when the quadratic 
ictional in log A, is neither positive nor negative 
finite, the limits x, 2, do not exist, and P,(x), Po(x) 
be expected to be different from zero for regions of x 
ywhere in (— ~ x < o), In fact, in order to complete 
» demonstration by showing that 0 < 63”, Bf? < 1in 


0 Middleton, op. cit., Reference 2, (19.20). 
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the limit n — ©, we must not only verify that the dis- 
tribution densities P,(x), P,(«) have no singularities, 7.e., 
the associated cumulative distributions possess no ‘‘mass 
points”’ anywhere, but we must also show that P,(x), Po(«) 
are everywhere continuous, for x > x;, % > 2% in the case 
of a positive definite quadratic functional in V(¢), and 
that in this case Ey, {x} = 2 > 2%, Ex, {x} = % > %, 
necessarily, with no finite regions in (%,1 < x < ©) 
where Py, P; are zero. With negative definite quadratic 
functionals, these regions are reversed, and when log A,r 
is neither positive nor negative definite, the requirement 
is that P,(x), P(x) are continuous, alla (— © <4 < @). 
Then, in each instance if @, Z, are finite, Bj”, 6,” can be 
neither zero nor unity, and the optimum test (log Ar = 
log & for H,, log Ar < log K for Ho, where K is some 
finite threshold) is accordingly regular. 

We begin with the quadratic form ®, = V (K;’ — 
K;')V and write it alternatively 


@, = VK;‘(I — K,K3)V = —VK, HiV =a) 
or 
= VK>'(K.Kj' — DV = —VK,j’*HaV, (9b) 
where 
Hig = KK, —I° “Hye TK Ke eo) 


define H,), H,;. From (9c) we get directly the basic 
relations 


H,K = Ki Koy @ = 146.0. =— 07a = 0 bee (10) 
Now, consider the expectations 
oo) = =n Evin.{ Vi V;}(Ko Hus); = —trace H,,. (11) 


Next, let Ha, = L.,At, At = T/n and pass to the limit” 
(n — o), obtaining for (11) 

T+ 

oP =-[ Lull, dt (12) 

(Oe 
where the L,, are now determined from the pair of basic 
integral equations, obtained from the limit of (10), vzz. 
(2) above. 

The bias B7, Eq. (8b), similarly becomes 

Br = log po — ¥ lim log det (I + K,K,* — I) 


no 


lim log det (I + H,,) 


n> 0 


D,o(1) = log tio + 3 Doil(—D), 


where D,0(1), ©oi1(—1) are the Fredholm determinants 


= 10g tio — 3 


(13) 


1 
= log uio — 3 


This could also be expressed as a Stieltjes integral. Necessary 
and sufficient conditions for the existence of solutions La, of (2) 
are that Ki, Ko obey the conditions assumed above for positive 
definiteness, etc. For if we fix ¢, for the moment, in (2) we see that 
the resulting integral equation is a special class of a more general 
inhomogeneous type treated earlier, cf. Sect. 19.4-2 of Middleton, 
op. cit., Reference 2, the discussion therein, and references. 
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Tie, GE x0"), Ta a and eat te 
eigenvalues of the associated homogeneous equation 
(3).'" Note that the ®;” are, in effect, the first iterated 
kernels of (3), and so we have also 


= Gq = 
(a) (ab) 
ct. = = x 
: dX : : = 


Consequently, for 5° and By to exist, it is sufficient 
that >°°, AS*” be finite, cf. (1), since the convergence of 
the Fredholm determinent is insured by the convergence 
of the series (14)."° 

To complete the proof, we need next to consider the 
characteristic functions (c.f.’s) of Po(w) and P(x). We 
start here with the c.f.’s for log A,, which are readily 
found to be™ 


b= 0. 
b=] 


3} 


(14) 


itBa 
F(té)n —— {det (I ae Fash. he (15) 
which for n — © become 
EG) 7 =e (tae (16) 


for P,, a = 0, 1, where 
ar {Nba ae 
j= 


But, by a theorem of Gnedenko and Kolmogoroff,”’ the 
P, cannot be the distribution densities (d.d.’s) of discrete 
(or lattice) distributions, 7.e., the distributions associated 
with the densities P, cannot have ‘‘mass points” since 
clearly F(z), # 1 for all € ¥ 0. Moreover, there cannot 
be more than one region where P, = 0, when — @-is 
positive or negative definite, and this region occurs for 
xX < Xo, % OF & > Xo, U1, respectively. Also, when ©, is 
neither positive nor negative definite, there is no region 
for which P, vanishes, - © < x < oo. Consequently, 
the distribution densities P,, a = 0, 1, are continuous 
and bounded, and, therefore, 0 < B{”, B{° < 1 as required 
for nonsingularity. 

Further, it is easily established that all moments of 
these d.d.’s exist under Ho, H,. For, differentiating the 
c.f.’s (16) with the help of the author’s expansion’® and 
setting £ = 0 in the result, yield’’ 


fo) 


Brae NE a: 


7=1 


ao 


FD ly sete 


7=1 


I 


(17) 


By comparing the higher-order semi-invariants with the 
corresponding moments, it is readily seen that x” 


* Middleton, op. cit., References 2, (17.5) et seq. 

18 [bid., pp. 725, 726, 730. 

4 Tbid., Sect. 20.4-7 [for example we may follow th 
indicated in (2) of this Section]. : ‘ oe 

* B. V. Gnedenko and A. N. Kolmogoroff, “Limit Distributions 
of Sums of Independant Random Variables,”” Addison-Wesley Co 
Reading, Mass., p. 5, Theorem 5; 1954. i 

16 Middleton, op. cit., Reference 2, (17.19). 

17 Thid., Sect. 17.2. 
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0(#"), and if |@| < ©, 1.e., if once more aA? 1s 
vergent, all moments accordingly exist. 

Now in fact, we can establish the necessity and suf 
ficiency of the condition |> >? A\*”| by considering thi 
series >.; dj, [A; = Aj°” for brevity] where 0 < ». H@ 
suppose v > 1; then since the mth semi-invariants ar 
>>; A”, all semi-invariants (m > 1) are defined. This 1 
clearly a necessary condition, since ae A, defines &, 
Alsomit 0 <9. and >>, \ is bounded, we have clearly 
a sufficient condition, and one in fact that is too strict 
But for y = 1 both sufficiency and necessity meet’*: the 
existence of #, is established, and all moments, as well ai 
all semi-invariants, are defined, also insuring the regula 
ty of the test. 

The proof of singularity [Theorem 1(b)] now follow; 
immediately: the necessary and sufficient condition f 
singularity is simply that 


Sr, ] 2 | 


with respect to hypotheses H,, H,, by obvious substitu 
tions of divergence for convergence at appropriate place 
in the preceding demonstration [Theorem 1(a)]. Finally 
we remark that these results apply for both stationary 
and nonstationary processes, as long as the fundamenta 


assumptions (1) and (2), Section II, are obeyed. 


IV. ALTERNATIVE RESULTS FOR STATIONARY 
PROCESSES WITH RATIONAL SPECTRA; 
Proor oF THEOREMS 2(a) AND 2(b) 


When No, N, are stationary, as well as normal, an¢ 
possess rational spectra W,, “,, alternative forms o 
Theorems 1(a) and 1(b) maybe obtained in terms of thes 
spectral densities, cf. (5a)—-(6b). We begin here with th 
proof of regularity, Theorem 2(a), and then establish th 
necessary and sufficient conditions for singularity 
Theorem 2(b). 

To derive necessary equivalent and sufficient condi 
tions (5a), (6), we start with integral equations (2), inter 
change ¢ and 7 therein for convenience, and write (2) a 


( La(r, WK (a — tid = Ki — a) 


ST = |) 


GUE ara Ob a <i 


where we have used the stationarity property K, (t, uv) = 
Kit 20) eb == 10 ale 

Our next step is to regard 7 for the moment as a param 
eter and observe that (18) is an inhomogeneous Fredholn 
integral equation (of the first kind) which can be solvec 


8 In certain cases as J. Feldman (“Equivalence and perpen 
dicularity of Gaussian processes,” Pacific J. Math., vol. 8, p. 699 
1958) has shown, necessity and sufficiency are obtained wher 
i A; is bounded, while >); \; can diverge. Here, the bias B: 
and data operator ®; both diverge in such a way that the tes 
yields finite nonzero and nonunity probabilities of error. However 
for practical applications this situation is clearly unrealizable, a 
it yields an unspecifiable system structure (embodied in Bp an 
7) so that the convergence, or divergence, of >; \; remains th 
significant condition. 
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rational kernels, in the manner of the author.’? The 
ional kernels Ky, K, by the Wiener Khintchine theorem 
e the corresponding rational spectra.” 


Mo No 
eC. Leo et) i TL" 40% 


n=0 


N Gop” 
Tye ROE z i ore) wal Oa) 
ld 
M, . Ny 
=a Tor +o) / Tee +5 
n=0 n=1 
Ni (lb LON) 
Sey ae ay) 
a be oh ae 
nO Oe 0. Re Gb. 0. °Ne., > Meg + 1, 


here forn = 0, ¢. +’ is replaced by unity.”’ In addition, 
(t, 7) is required to be differentiable on (0 — <t,7 < T+) 
» the appropriate order, and for the moment we assume 
1 spectral poles and zeros to be simple and distinct, a 
striction easily removed at later stages by the obser- 
ation that the cases of multiple poles may be treated by 
suitable limiting process, e.g., b, > brs2, ete.” With the 
bove modifications and assumptions the general pro- 
sdure for solving (18) is described in detail elsewhere,”* 
ith examples.”* Here, however, we shall first somewhat 
.odify the approach referred to above, in order to reveal 
irectly the spectral forms (5), and then return to this 
riginal approach for explicit evaluations of L., (7, ¢) 
£(t, T) ete. 

Since the kernel Ky in (18) is continuous everywhere, 
tus set G'* = G(T, 7), G(r) = G(0, 7), and following 
1e steps given elsewhere,’ let us rewrite (18) fora = 1, 

= Oas 


Beret, Nac urls = OU, 7) 


GG) exp [—e' Pe — Ti ss G(t, T) 


ee ACen aah 
+ <0, OR reall (20) 
Ge pecsple HG ait at (i, 7); 


t<0 


19 Middleton, op. cit., Reference 2, Sect. A. 2.3. r 

20 Rational spectra may be generated, for example, by passing 
iginally “white” noise through a linear, stable, invariant, lumped- 
mstant network. Thus, if 


No 
Keds sae sa, exp(—b, | t — 7)/); 


9a) is the associated spectral intensity density; resolution into 
wrtial fractions determines the a, in terms of the c,“), and vice 


rsa. 
2 Middleton, op. cit., Reference 2, Sect. A.2.1, p. 1082 et seq. 
2 Tbid., footnote on p. 1083. 
23 Tbid., Sect. A.2.3, pp. 1086-1091. 
24 Tbid., Sect. A.2.4. 
26 Thid., (A.2-22)-(A.2-24). 
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where [yo (7, t)7 vanishes outside (0 — <t< 7+) and 
is equal to Lo (7, ¢) inside, and where Xx” is zero for 
Lae 1 and x’ vanishes for ¢ > 0. The constants c‘~’ 
are to be chosen presently [cf. (23)] and the exponential 
factors, along with the known, convergent behavior at 
+ o of G, viz, G(4 ©, 7) = 0, insure proper convergence 
of the right member of (20) at infinity. From the con- 


tinuity of the kernel it is clear that © (7, r) = 


Go 


(0, 7) = 0, allz in (0, 7). Thus, the approach at this point 
uses this continuity property, along with the fact that the 
kernel Ko, corresponding to (19a), can be represented as 
the sum of exponentials, to find these as yet unknown 
functions X‘~’ (¢, r). When this is achieved, Fourier 
inversion of both members of(20) with respect to ¢ yields 
the Fourier transform (I'.T.) of Zyo (7, ¢)7, from which 
Tyo (7, t) (and Io (t, 7)) follow in turn. Paralleling 
the author’s’’ steps, after taking the Fourier transform 
of both sides of (20), we write after a little manipulation 


= cor ge dp 
ee ibe QrIW 9 (p/ 2x1) 
co) 


else Dele 
se) ate (=) 
aie URE MO 5) 


: | set. T) ale 


= 


% / CO i 
T+ —o 


+ X'(p, 7) + XG, » | , 0O- <t<T+, 


Gla, Te Ore 


= 0 elsewhere, (for £), 


where by definition 


Se(p, ee / 6 Gro, 1) a z5 


= @ "|W, (p/2ni) — W(p/2ri)]. 


(21) 


(22) 


Here X‘~ (p, 7) are the F.T.’s of X°~ (é, r),”” with p = 
iw = 2mi, and by analytic continuation p is allowed at 


the appropriate stages to assume complex values. 


Next, let us follow the direct procedure as indicated 
above,” to obtain the somewhat more useful form for 
explicit calculation [cf. (27), (28), below], using in place 
of (20) the “extended” form of G,”* and carrying out the 


steps indicated by the author.” The result is 


ony pt HSE 
~ = 1) a € dp i —PTo 
Lyon, t), “ thee Qi W’ )(p/2n1) af Git; T)e dt 
CS? rae Go 
ae awe p ie) = 


+ xp, 7) + XL (p, » | pO et a 


= 0, pee ies pe Ila, 


26 Tbid., (A.2-25)-(A.2-31). 
27 Tbid., (A.2-21, 27). 

28 Tbid., (A.2-24). 

29 Tbid., (A.2-25)-(A.2-43). 


(23) 


LLO 


in which 


oe (p, 7) 
W o(p, ni) 
, & —?? or 1/008? — By”) Panes. 
= Yr) Gem ay Wa@/2r). 24) 


= . 30 
Here we have set c = b, = c°” for convenience.’ The 


2N, — 2 undetermined functions of 7, T'\* (7), are found 

by introducing the solution (23) into the original integral 

equation (18) and treating the ensuing relation as an 

identity. When this is done, it is found that the I',~” (7) 

are linear functions of G,G, G, «+: ,@O?-"", att = T, 

0, where differentiations (dots) are with respect to t. 
Combining (24) and the above, we get 


— ¢@ [Wilp/2nt) — Wolp/2nt) | e 
iol Hes i | W(p/2n1) | 


+ 2|K,(T — 7) — KT — all Rawr ees 
+ 2[Ki(7) — Ko(7)Je* Pen 
i 2(K,(t — 7) aie Ko(t = 7) \Preeren 


+2 (oi? — 


n=2 


{rs a 5 ie ee Me /2 3 dp 
wi (OS + pO” +p) “OP Dei 
a= T.. G@) I Gis 7) Wo(p/2nt)” 5 ep P 


(3 
— pb” — 
0 — <t,r < T+, (25) 


p(t—T) 


Qa ap 


6") 


where t—T7, etc. signifies that the preceding quantity 
is nonzero only fort > T, etc. Note that Lyo (7, t) = 
for all ¢t outside (0 —, T +), but that Dyo (7, t) does not 
necessarily vanish for 7 outside the square (0 — < 4, 
7 < T +). In fact, Lyo (7, t) ¥ 0, generally in the strip 
O=— <1 = 2 --), all 7, and, moreover liqr9) ss elins 
(t, 7), corresponding in the discrete, matrix forms (9c), 
to the fact that K,K>* ~ K,;’K, (unless K, or K, = I). 

An alternative form for (25) which is often more con- 
venient for explicit computation may be obtained from 
(23). It is explicitly 


| coy Coa 
Lge dy 2 hie Wo(p/2ni) {Kv — 7) — K,(¢ — 7) 
p(r-T) 
ar oe [A(T =e T) ame K(T a 7) 
+ jm Te (KG) — Kan) 


PAG isto) 


ae — he 6 (re ; é 
2 | OC Ene” +p 
sF Ty '(1) 7 (0) 


ae) dp 
pox” — p)/) Qri 


%° Ibid., the comment following (A.2-88) on p. 1089. 


(26) 
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Apri 


for0 — <t,7 < T 4, with Ly (7, t) = 0, when ¢ is ou 
side (0 —, T +). 


As specific examples, we see at once from the sam 


source, in the case of RC spectra, that 
_ pf | wilp/2m) = sy vin) OM 
Lyo(7, re = i | Wo(p/2ri) a é an 


+ [K(T — 1) — K(f — 1) + K(f — 7) 
— aK (fT — 7)] 6¢ — T) + [—Ei(r) + Kolz) 
+ aKi(r) — agko(a| 6 — 0) 0 eaten 
where specifically 
K(f) = yer Ree ae 


Axo 4a, 


Wega) eas 
Note that 
K,,.(0) = 5 lim [K,,o(0+) an K,,0(0—)] = 


here; observe, also that the integral in (27) is simply the 
spectral equivalent of the time-form 


rhe 


vedas — G)iKU — 2) — Kile — Nao 


Similarly, we find directly from Middleton,” that 
LRC spectra 
L,.(7, ture 


2 cr pie = Seelp/2nd | 
4 W o(p/ 271) LRC 


+ [H® + AR = 0H 4+ 20? wh’ H)_, 8(t — T) 
— (H+ 208 + ofa, 8-7) 


for 


SE 


pe OD 
ROA) ML 
y Qa 


4 ® — 40" = oO 2 eon) 
+ [HB — 20H + w{H], 6'(t — 0), 
0- <t<T+, (28) 
where now H(x) = K,(“) — Ko(a), and 
Kine = va exp (—or” | t a 
(cos BRM mo sin w,” | ¢ ) (28a) 
W.(p/271) tre 
= Wi /loh* — 22%" — f?*\p? + p'), (28K) 


with, Wi? =" Svat a. Seo yoreis (he wp etc. In both 
cases, of course, Lyo (r, nie 0, ¢ outside (0 —, T +). 
As in the RC case above, we readily find that the integral 


31 Tbid., (A.2-48). 
# Tbid., (A.2-19), (A.2-54), (A.2-55). 


(28) is again the spectral equivalent of the time-form 


2 (0)4 (0)? vee de 
| Ce Ri oe aa 


(Kit ar T) = K(t oa T)|iRe: 


— 2(Qwe” 


ww e are now ready to compute {6* Lio (t, t)dt as required 
(1), (14), and (17) et seq. for the n. and s. condition of 


pularity. Setting 7 = ¢ in (25), we have directly 


° Lyo(t, t) dt = 27 ic | wo = | df 


Wolf) 
+ {a finite number of finite terms}. (29a) 


re unspecified finite terms referred to in (29a) are the 
sult of integrating (with 7 = ¢#) the sum in (25) and 
serving that typical integrals are of the form 


T+ 
| KAT — 1) 8 — T) dt, 
O= 


T+ 
‘| KA.6 ’ @ — 0) ai, 
o- 


here A,B =0,1,---,2N.-2M,—1,0<A+B< 
Vo — 2M, — 1, with various combinations of lower- 
der derivatives of K,.» and the delta functions.** 
itegration always yields a finite result, since K‘{°}(t) 

>, (d°/dt°) a,e’"'*' possesses all derivatives for 
> 0 +, and, in particular, for ¢ —~ 0 + here (C = some 
teger or 0), while K§°} (7 +) is also always bounded. 
foreover, derivatives of K,,. never occur here to an order 
gher than 2N, — 2M, — 1, and Kj’%’?”°-” (0) is 
nsequently always finite [cf. the RC and LRC examples 
ove, for instance]. A similar remark can be made of 
(No~?Mo-1) (Q) if we observe that convergence of the 
tegral in (29a) implies that W,/W>) = 1 +0 (p ”), and 
mee that 2N, — 2M, = 2No — 2M>. In addition, the 
nspecified” terms in (29a) are always O(p'') in the 
tegrand vis-d-vis the leading or spectral-ratio terms, as 
amination of (21) shows, so that the latter dominate. 
hus, although Ly (¢, ¢) will usually contain delta func- 
ons** and their derivatives to an appropriate order at 
e two points ¢ = 0, 7, their contributions to the integral 
the left member of (29a) are finite, and consequently 
is the spectral term that establishes the convergence of 
is integral, and hence of the statistical test, by (1)-(8). 
precisely similar argument, starting instead with 
= 0, b = 1 in (18), yields 


alt, ) dt = 20 ile ki ss wolf df 


+ {a finite number of finite terms} , 


(29b) 


hich may be combined with (29a) to give the composite 
rm (5a) of the n. and s. condition for these rational 


33 Tbid., the comments on p. 1091. : ; 
* An exception is the singular case where either Ni or No is 
rhite’’. 
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spectra. If, in addition, we require that these rational 
spectra’’ in the ratio W,/W, (and W,/®W,) are finite and 
nonzero’ for all (0 < f < ~) we can then drop the integrals 
and express the n. and s. condition in its equivalent limit 
form (5b) above. Finally, we observe that the T'S that 
appear in the unspecified finite terms referred to in (29a), 
cf. (25), are, of course, finite themselves, by the argument 
following (29a). 

The proof of Theorem 2(b), for the singularity of the 
Bayes test in the case of rational spectra, is at once 
established by the same argument used in proving regu- 
larity above, where now the appropriate conditions of 
convergence are replaced by divergence. It remains only 
to show that (29a), (29b) in additive combination, 7.e., 
(6a) here, is the controlling expression vis-d-vis the finite 
number of now possibly divergent terms in the sums over 
n in (25) for both LZy> and Ly;. From (21)—(25) we see that 
the terms in X‘“~? (p), and hence the “unspecified” terms 
in (29), once more are 0(p~*) in the integrand vis-d-vis 
the leading or spectral-ratio terms in these expressions. 
Consequently, the singularities of these leading or spectral- 
ratio terms in combination are always of a different and 
higher order than those of the ‘“‘unspecified”’ terms when 
f(or p) — o, and are indeed the controlling terms, 
as required. For example, if W,/W»> — 1 is O(f?) asf > ~, 
then the “unspecified’”’ terms are O(f). Also, 1 — Wo/W,, 
is therefore 0(f°), with its associated ‘unspecified’ terms 
O(f-*). When these two sets of terms are added, the 
divergent spectral ratio terms are O(f’) vis-a-vis O(f) of 
the “unspecified” terms. This completes the demonstra- 
tion of Theorems 2(a) and 2(b). 


V. NoNRATIONAL SPECTRA; SPECIAL CASES 


There remains the question of nonrational (nonband- 
limited) spectra in the stationary cases. Theorems 1(a) 
and 1(b) apply here, of course, but do not explicitly 
indicate the dependence on the spectral distribution. In 
the situation where nonrational spectra can be regarded 
as limiting forms of rational spectra, cf. (19) and for 
which the “end-effect” terms [7.e., those involving TS”, 
cf. (24), (25)] also yield a finite contribution to the integral 
as in (29), the relation (5a) applies, by the argument of 
Section IV above for regularity in the rational cases. 
Similarly, (6a) applies for singularity, and Theorem 38, 
Section IT, is the result. 

Although we are not able at present to establish that 
(5a) and (6a) are the necessary and sufficient conditions 
for all nonrational spectra, we conjecture that this is 
indeed true, for on physical grounds alone we expect this 
to be the case, since nonrational spectra, for example, with 
“holes” on a finite frequency interval will lead to singular 
tests, cf. the remarks in 1) of Section VII below; while for 


35 We remark again that the situations of multiple poles and 
zeros may be included here by appropriate limits on the coefficients 
Gn, bp, ete., so that our results apply for all (finite intensity) 
rational spectra; cf. Middleton, op. cit., Reference 2, (A. 2-58) 
and comments. 
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regularity the integral must at least be bounded. The 
main difficulty in proving the conjecture lies in showing 
that the terms in %‘~’(p) here,*® cf. (21)-(25), are indeed 
suitably finite on the one hand, and have lower-order 
singularities than the spectral term on the other hand, 
analogous to the behavior in the rational cases considered 
above (Section LV). 


VI. BANDLIMITED SpectTRA: PRoor oF THEOREM 4 


As a final example of nonrational spectra, let us con- 
sider bandlimited processes’ on (0 < f < B). Here we 
outline an alternative proof to Slepian’s earlier result,’ v7z., 
that a sufficient condition that the Bayes test of two 
stationary gauss processes, V, vs No, be singular is that 
one (or both) of the processes be bandlimited. This is 
easily shown from the result of Theorem 1(b), vzz., (4) 
and the demonstration in Section IV, for from the author’s 
relation” we may write the various covariance functions 
K,, Ko, Ky) = K, — Ky of these bandlimited processes as 


sin 27B(r — k/2B) 
20rB(r — k/2B) 


Keen = then eB) (30) 
and insert this into the basic integral equations for Lio, 
Lo, cf. (2). We observe directly that the solutions of (2) 
are then of the form a,6(¢ — w), all k, so that the integral 
fo- Lar(t, )dt > ©, and consequently, that bandlimited 
processes lead to singular Bayes tests. Bandlimiting is 
clearly a sufficient condition, but not a necessary one, for 
singularity can also occur when the noise processes possess 
rational spectra, cf. Theorem 2(b). 


VIL. ConctupiInG REMARKS 


Some of the principal implications of the preceding 
analysis may now be briefly summarized: 


1) We observe first that the mathematically significant 
models of physical situations (involving the optimum 
tests above) are nonsingular. The singular model, if it is 
chosen or constructed, is not an adequate, or even accept- 
able representation, from an applied point of view, since 
it leads to physically unrealizable outcomes. As an 
example, let us suppose that one of the noise processes in 
our treatment above has a finite spectral gap on some 
frequency interval where the other process does not. 
Then it is clear that we would expect a perfect test of 
H, vs Ho, as confirmed by condition (6a), simply by using 
a filter located in the gap and observing its zero or non- 
zero output, as NV, or No occurs. Similar examples can be 
constructed: for example, if W,/W, does not approach 
unity for f > ©, or if W,W, = 0 at some f = fy, etc., cf. 
(6b). 

2) It is not necessarily enough, however, that a test be 
regular (7.e., nonsingular) for it to be an adequate repre- 


36 The sum over 7 in (25) is replaced by two unknown functions 
of t, 7, while the other terms remain unchanged. 

37 These include processes with one or more bandlimited com- 
ponent processes, as well. 

38 Middleton, op. cit., Reference 2, (4.37). 
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sentation of a physical situation. This is indicated by the 
following example: Consider the FSK situation, where 
sinusoidal signals, transmitted through a scattering 
medium, are received as narrow-band normal processes, 
e.g., fast, normal fading, No, N, above. Now suppose 
that each FSK and corresponding scattered signal, is of 
equal intensity, respectively, and that their spectra are 
identical except for location, or in any case are such that 
(5) holds. Detection of V, vs No is accordingly nonsingular, 
But, let us change the level of one of the transmitted 
sinusoids; then lim... W,/Wo # 1, and we have a singular 
situation, which according to our model can occur for the 
slightest difference in level here. Physically, of course, we 
know that perfect discrimination does not occur under 
these circumstances; we are at least ultimately limited by 
the inherent noisiness of the observation process itself, 
here generated by the receiver. An acceptable model adds 
a background noise N(¢); thus, NV, S. + N; No & 
S, + N, where S,, S, are the received FSK noise signals. 
In this condition, an equivalent statement of (5a) is for 
rational spectra and for certain limiting classes of sation 
spectra | 


Wolf 6) 


Similarly, in the “on-off” problem analyzed earlier by the 
author,’ where VN, = S + Ny; No = No, the n. s. cons 
dition (5a) may alternatively be expressed as 


* 8) 9(f) 
0 W v(f) 


Both (81) and (32) require a suitably rapid fall-off of 
W s(f) vis-d-vis Wy(f) as f > ©, €.9., Ws/Wn = Of FJ 
which in the rational cases is O0(f’) at least (and that 
W s/Wy is bounded and nonzero for 0 < f < &). 

3) The above suggests that a sufficient condition for 
“stable” regularity, and hence an acceptable model, is 
the addition of a suitable background noise, in physical 
situations a thermal process of some kind, generated 
either internally or externally to the receiver, whose 
spectral extent and behavior as f — © always insure the 
conditions (81), or (82), or (5). 

We remark that other possibilities insuring regularity 
may also exist. For example, if the uncertainty with which 
spectral shape is measurable is significant compared to the 
perturbing effects. of an additive background noise, this 
uncertainty, represented analytically by one or more 
random parameters, é.g., spectral width, fall-off at high 
frequencies, or other ‘‘shape-factors’’, may be enough te 
establish convergence of the test, with, of course, appropri- 
ate averages over these random parameters in the optimum 
structure (7), cf. the analogous situation with deterministic 
signals.*” In any case, the appropriate approach is the one 
which incorporates the dominant uncertainty in the 
physical model. 


Dal df < (32) 


39 Tbid., (19.20), (20.1). 


4) In the “stable” regular cases, then, the exact spectral 
tributions for large frequencies are not critical; de- 
tion is essentially a distinction between energy states, 
td it is not the detailed spectral shape that is controlling, 
ovided, of course, that conditions like (5), (31), (32) are 
tisfied. This is what allows us to apply with success in 
actice our analytical models admittedly imprecise in 
ptail.*° Of course, an optimum system attempts to 
atch” itself suitably“ to the incoming waves: broad 
bectra require broad filters, etc., a fact taken into account 
radiometry theory and practice, for example, where the 
sign trend is toward increasingly broad filters, using 
avelling wave amplifiers, etc., to match the radio sources 
onder study, themselves spectrally very broad. For given 
rror probabilities in detection, the result is a correspond- 
¢ reduction in effective data acquisition time: the 
roader the spectrum the shorter the period one needs to 
nake an observation at a given error. In this sense, we 
night say that here design based on regularity, in taking 
nto account spectral behavior at high frequencies, 
pproaches the limiting form of a singular test, which, of 
ourse, it can never reach for the reasons cited above. 

5) In the nonsingular cases, the passage from n sampled 
ralues of the process on (0, 7’) to the continuous limit as 
1 — o is valid for all adequate models. All pertinent 
nformation concerning the process is efficiently employed, 
ind none is thrown away (up to the point of an actual 
lecision). 

6) We conjecture that the conditions (5), (6), are also 
90th necessary and sufficient for regularity or singularity, 


40 Tbid., the comments on pp. 825, 826. 
41 Tbid., Sect. 20.2—4. 
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respectively, for all nonrational (nonbandlimited) spectra, 
although we have been able to establish this for special 
cases of nonrational spectra only, cf. comments in Section 
V and VI. 

7) Since bandlimiting is a sufficient condition for 
singularity in the stationary cases (Theorem 4), we might 
think it possible always to insure perfect detection with 
arbitrarily small samples simply by introducing an ideal 
band-pass filter (0 < f < B) at the front end of the Bayes 
receiver. Physically, of course, such filters in lumped- 
constant or distributed form cannot be made to be noise- 
free, so that a nonspectrally limited residual additive 
noise always accompanies the bandlimited input to the 
Bayes receiver, and the situation decribed in (3) is once 
more in force. Alternatively, if the ideal band-pass filter 
is represented by a suitable computer, it may be possible 
to eliminate the effects of inherent noise, but only at the 
expense of an infinitely long processing time, with the 
practical effect that singularity again cannot be achieved 
by bandlimiting in physical situations. 

8) By similar arguments, we expect the same general 
conclusions to apply for non-Gaussian processes, although 
the conditions for regularity and singularity are predicted 
to be much more involved, since the statistical description 
of such processes is likewise much more complicated than 
for the Gaussian process. 
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Corresponden¢® 


A Lower Bound for Error-Detecting 
and Error-Correcting Codes* 


The purpose of this note is to establish 
a new lower bound implicit in Theorems 
1, 2, and 3 below for error-detecting and 
error-correcting codes. 


Norations, DEFINITIONS, AND 
Previous THEOREMS 


Let G, denote the set of all binary repre- 
sentations of n digits. Under digit-wise 
modulo 2 addition, G, is a group of 2” 
elements. Furthermore, by defining the 
distance D(x, y) between elements x and 
y in G, to be the number of digits where x 
and y are different, G, is a metric space. 

Using this metric, Hamming showed in 
1950! that a subset G of G, forms a set of 
k error-detecting codes if G@ is such that 
x, y in G@ implies that D(x, y) = 2k. If 
D(a, y) > 2k + 1, for a, y in G, then G 
is a set of k error-correcting codes. Further- 
more, G is a group code if @ has the addi- 
tional property of being a subgroup of G. 

The number of elements in G is bounded 
above by the following limits established 
also by Hamming. Let B(n, 2k + 1) be 
the maximum number of k error-correcting 
codes in G,, and B(n, 2k) the maximum 
number of k error-detecting codes in Gp; 
then the following upper bounds hold: 


BE Gi el em 
IE i OS Oe 
BG, 3) = 2° 2/1) 
BOA 
Bin — 1, 2k — 1) = Bin, 2k) 
Big cielo 28 [i 


where m is an integer and denotes the 
number of digits that may be used for 
information bits, and where C(n, p) denotes 


the binomial coefficient . ; that is, 


C(n, p) = n!/[(n — p)!p!). 


In 1959, Shapiro and Slotnick? presented 
two results on lower bounds. They are 


* Received by the PGIT, June 13, 1960; revised 
manuscript received, August 4, 1960. 
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Btn, b) > 2/[i Caen 


and, for an infinite sequence of n, 


Bin, k) > 2"/[L + Cn, 1) + -- 


A New Lower Bounp 


With this as background, I should like 
to establish a new lower bound for error- 
detecting and error-correcting codes. 


Lemma 1 
For fixed integers a and k, there exists 
N such that whenever n > N, 


k-1 k-2 
> Cn — a, 1) > 2 > Cn, 0). 
1=0 i=0 


Proof 
Express 


k-1 k-2 
Y 6G 2 Cae 
i=0 i=0 

as a polynomial: 


sf ilies ee 


Opener wr Cee = 


It is clear that ax_1 > 0. 

Lemma 1 now follows as a consequence 
of the fact that if a polynomial in n has 
positive first coefficient, it is greater than 
zero for n large. Q.E.D. 


Lemma 2 
For group codes,? if 


Bin, k) 
9” 
OG ae une 


then 


Ci kh — 2 


Bin + 1, bk) = 2BQ, k). 


Proof 
See Shapiro and Slotnick.? 


Theorem 1 
For group codes, 


B(n, k) > A 


+ Cn, k — 1)], 


+ On, k — 2)). 


1+Ca—-1,)+-- 
for n sufficiently large. 
Proof 


By Lemma !, we can choose for fixed 
k, an N such that whenever n > N, 


k-1 k-2 
Cm - 1,1) >2 0 Ch —- 1,9. 


3 For a discussion of the properties of group codes, 
refer to D. Slepian, ‘‘A class of binary signaling 
alphabets,” Bell Sys. Tech. J., vol. 35, pp. 203-233; 
January, 1956. 


Cin — 1,k — 1) 
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—~ 


| 
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| 


~ 


Correspondence 


Suppose that 


nee 


Bin —1,k) < 
then, by Lemma 2, 


Bin, k) = 2B(n — 1,k). 


Using Shapiro and Slotnick’s lower bound, 
we have (1) above, 


yo 


ToICGe= 1 ce. CG. b=). 


Bin — 1, k) 


therefore, 


Bin, k) = 2Btn — 1, k) > 


= = : 
eH OG sel Lyne OG le eae 


OX 


Suppose that 


Oe 


1+Cm-1,D+.-:-C@—-1,k —-D 


then 


Ban, k) 2 Ba — 1,k) 2 


whenever n > N. Q.E.D. 


Theorem 2 


For fixed integers a and k, there exists 
N such that whenever n > N 


Ciel ea ano 


Dae 


Tt Cn Tate C ne ee) 


Bit 


= k—-2 
1=0 


OF 


a 
DX Ca — 1,1) 


Bak) = 


for group codes. 


Proof 


By induction. 

Let k be a fixed integer. 

Let a = 1. Theorem 1 shows that the 
above statement holds. 

Assume that the theorem holds for 
a = a. Then it suffices to show that the 
theorem holds fora =a@+ 1. 

Let N; be the number such that when- 
evern > N;, 


CG So a) ee Cn Saeed) 


Ope 


Bn, k) 2 


Let Ng41 > Ng + 1, and 
k=1 
> Ca -— & — 1,1) 
i=0 


when n > Ng+i1. (We can choose such a 
Na41 due to Lemma 1.) Let n > Ng41. 


UO G=e 1) OG sa eae 


k-2 
22 Co 1,4) 
1=0 
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Case 1 


Suppose 


on , 
1+¢:6G = 1,19 CG 


Ba — 1, hk) < 


then 


Ore 
Bln, b) = 2B(n — 1, k) > 1+ 0G —a — 1,1) Fe CG ee 


Be ; 
“14+Ca—@t), Dp = Ce S[ey fe) 


Case 2 
Suppose 
gr} 
Ba 1) 27 6 = 1, aC 
then 


CH =) — 
2. >) CH. — 154) 
i=0 


> 2" : 
1+ Cm — @-+ I), 1) PCa eae) 


Q.E.D. 


Lemma 8 


If 


k-1 k—2 
Cm —= 1655 ) zs 2 Ely 2), 
i=0 i=0 


then 


¥ Om +1 2,9) > 2 xe Ca + 1,0. 


Proof 
k-1 k-1 k—-2 
Y Cat P= 4,0 = 3) Cn —a ey Caer 
i=0 i=0 i=0 
k=2 k—2 k— 
2 >>C@+ 1,1) =]=2 >) Cary > C(n, 1). 
1=0 i=0 =(0 
Hence, it suffices to show that 
k-2 k-3 
>) Cu —a,i) >2 > Ca). 
7=0 1=0 


That is, we want to show that 


Correspondence 
k-2 oat 
2, Cm — a, 1). Cc Ceo 
3 a= 
2 Dy C(n, 1) 2 S Cin, 1) — 2C(n, k — 2) 
Ca = a, k-— 1) _ 20M, k — DY 
SS TSS 


2, CM — a, 1) . 2 ¥ ot, a 


4=0, 


2¥ CW,9) Mee 20 O(n, i) 


Cw =a, 4) (mee 2 Oh ~ 4,0 


et us compare p with q: 
Cn —a,k — 1) . Cin, k — 2) 
k—-1 ‘< k—2 ) 


e Cin — a, 1) ya, Cot) 


PSG, 05 


rovided 


(m— a(n —1—a)-::(n-k +2 —2) B=) Maa Dk S| 
| Cay | re Bi (b — 2)! 


2! (k — 1)! 


fut Deeate a], yy p@rmmnind Wad eben] 


(k — 2)! 


In order to prove that the above in- 
quality holds, let us express it as follows: 


ee a) (ns — bee — ia) 


Ju. ae A, =F ata se A,-2| 


(k — 1)! 

here 
Val bet Ga) 
aa p, = Bohs toa 

(vn — 1) Oe OO ee) 
ar Ce 3! 
ee ve Oh eo) Be pay ES 2 Ie ae 
as (k — 2)! i (k — 1)! 


_ term-by-term comparison shows that 
reach 7,7 = 1, --: k — 2, 
L—a)(n-—1—a)---(n—k+2—a) vile n(n — 1) - ‘m—-kt3) p 
< 
(k — D! Gy a) 


GG 
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Thus, the inequality p < q does in fact 
hold true. 
Recall that by definition, 
Deals ie ix 

Hence p < q implies that 

a) 

eee 

(1 =@) 


Therefore, 


k=1 


> C(n — a, 4) 


1=0 >= Sil 
2 s C(n, 1) 
implies that 
k-1 
Cin — a, 
=J0F 2s Sy 
a axl) is 


2 C(,8 1) 


This gives us the desired result. Q.E.D. 


Theorem 3 


Given n, k, let a be largest integer such 
that 


Sey Sey >2 5 Cm —1, OMe 


+=0 


Then for group codes, 


BOR 
» Cin — a, ) 


Proof 


This follows as an immediate conse- 
quence of Lemma 3, the previous theorems, 
and results of the proofs of the previous 
theorems. 


SUMMARY 


Table I contains a comparison of the 
new lower bound with Shapiro and Slot- 
nick’s lower bound (1), and with Hamming’s 
upper bound. The reader is reminded that 
the maximum number of k-error correcting 
or detecting codes is an integral power of 2 
[7.e. B(n, 2k) = 2”). As is evident from the 
Table and from the statement of the 
theorems, the new results are considerably 


TABLE I 
Shapiro 
and 
Slotnick’s 
; Lower New Hamming’s 
Magnitude Bound Lower Upper 
of n, k (1) Bound Bound 
to 10) k= 4 28 24 25 
m= 20, kb ='5 27 28 212 
n= 20, k = 4 29 212 214 
nm =40, k=5 234 226 230 
n=40, k=4 227 230 233 
nm =100,4 =5 279 282 287 
n= 100,k =4 283 287 292 
n = 200,k =7 2164 2168 2179 
k = 4 => double error-detecting 
k = 5 => double error-correcting 
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stronger than Shapiro and Slotnick’s lower 
bound (1). 

A comparison with Shapiro and Slotnick’s 
lower bound (2) was not included in the 
Table since in this case the lower bound 
holds only for some unspecified infinite 
sequence. However, for any given n for 
which the lower bound (2) does hold, the 
result is a lower bound that is greater than 
results of the new theorems. 


(Mrs.) Peaey Tane STRAIT 
Research Associate 

G. C. Dewey Corp. 

New York, N. Y 


A Simple Proof of an Inequality of 
McMillan* 


Let 1;,2 = 1, , b, be the length of the 
ith word of a list of b words, each word 
being a string of letters from an alphabet 
of a letters. Assume that distinct strings of 
words from the list, when written out 
without additional space marks to separate 
the words, determine distinct strings of 
letters, so that the total number of strings 
of words of letter-length k is < a*. Let 
1 = max, l;. Then for all integers n > 0, 


(ao) 


bn 1 


a oo 
i=1 @ 

where 7 runs over the b” strings of n words 

and L; is the number of letters in the jth 

string. Since max; L; = nl and min; 

L; = n, we have, grouping j’s with L; = k, 


Apri 


Note on an Integral Equation Occu 
ring in the Prediction, Detection, an 
Analysis of Multiple Time Series 


The Wiener-Hopf integral equation wit 
a finite upper limit 


ii “WEG = gmt 


ey 


Osta), 


where R(r) is the correlation function ©: 
a stationary process, is frequently en. 
countered in the theories of prediction an 
detection and in the analysis of stationary 
time series. About four years ago, th 
authors encountered a matrix form of thi; 
equation in the course of attempting to 
determine the amount of informatio 
contained in a finite segment of a stationar 
Gaussian process about a finite segment 
of another stationary Gaussian process, 
with the two processes stationarily cor- 
related with one another. This problem was 
subsequently solved by Gel’fand and 
Yaglom.! 

In working on this problem we have 
obtained as byproducts a vector form of 
the Karhunen-Loeve expansion and an 
extension of Preston’s generalized prob- 
ability-density functional? to vector Gaus-. 
sian processes. Some of these results were 
applied by one of the authors to the solution 
of optimal reception problems involving 
the processing of n(n > 1) signals.* 

The purpose of the present note is to 
give a brief account of the foregoing results| 
and, more particularly, to indicate a general 
method of solving matrix equations of the 
form (1) for the case where the elements of 
the spectral density matrix G(w) are 
rational functions of w. Such equations 
seem to play a basic role in the prediction, 
detection, and analysis of multiple time 
series. 


number of strings of » words having k letters 


IIA 
M 2 
IS 

IA 


Since x > 1 implies x” > nl for sufficiently 
large n, it follows that >7;.. a“ < 1, 
which is MeMillan’s! result. 


JAcK KarusH 

Dept. of Statistics 
University of California 
Berkeley, Calif. 


* Received by the PGIT, October 17, 1960. This 
note was prepared with the partial support of the 
Office of Ordnance Research, U. S. Army, under 
Contract DA-04-200-ORD-171, Task Order 3. 

1B. MeMillan, ‘Two inequalities implied by 
unique decipherability,”’ IRE Trans. on INFOR- 
Piri Tueory, vol. IT-2, pp. 115-116; December, 

56 


ak 


Consider the matrix integral equation 
T 

[ RG = NWO) dr = £0) 

0 


Os ts 7) 


* Received by the PGIT, July 1, 1960; revised 
manuscript received, September 29, 1960. This 
work was supported in part by the National Science 
Foundation. 

1J. M. Gel’fand and A. M. Yaglom, ‘‘Calculation 
of the amount of information about a random func- 
tion contained in another such function,’ Uspekhi 
Mat. Nauk, vol. 12, no. 1, pp. 3-52; January, 1957. (In 
Russian, oI 

2G. W. Preston, “The equivalence of optimum 
transducers and sufficient and most efficient sta- 
bates . Appl. Phys., vol. 24, pp. 841-844; July, 


3 J. B. Thomas and E. Wong, ‘‘On the statistical 
theory of optimum demodulation,” IRE Trans. on 
InrormaTion THeEOoRY, vol. IT-6, pp. 420-425; 
September, 1960. 
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ere R(r) is an n X n correlation matrix, 

W and f are n-vectors. Let R(t, 1) 
ote a matrix kernel inverse to R(t — r) 
the sense that 


ERY = 7)R “(7,8 dr 


ere I is the identity matrix. Then the 


Mm) =f wi» 
Rr, OG dé, (4) 


‘here the unit-step functions serve to 
it the range of integration to the interval 
, T]. This mode of limiting the range of 
tegration serves the purpose of resolving 
e ambiguity arising when R-(7, £) con- 
ins delta functions at the points & = 0 
dé=T. 

By virtue of (4), the problem of solving 
2) reduces to that of solving the matrix 
ategral equation (3). Before describing a 
nethod of solving the latter, we shall 
riefly indicate the manner in which this 
quation arises in the expansion of vector 
rocesses and in the generalized probability- 
ensity functional for Gaussian processes. 
For simplicity, we shall restrict the dis- 
ussion to the case of two stationary and 
sationarily-correlated second-order proc- 
sses, {x(t)} and {y(t)}, having zero means. 
‘or such processes, it can readily be shown 
hat w(t) and y(¢) admit of representation 
with convergence in quadratic mean) as 


“= Daw, 


y(t) 


Yas), ©) 


there the yg, and 6, are orthogonal in the 
ense that 


[o(é)e,(t) + 0,(2)0,(t)] dt = Bx, 


(u,v = EPO oe) (7) 


nd the a, are random variables given by 


= | Oe. + 44,00) at. ) 


Furthermore, the ¢, and 6, are eigen- 
inctions of the system of integral equations 


i) =>, f " [e@Relt — 8) 
+ 6,)R(t — D1 db, 
0 = [ beORult 8 
+ 6ORAt— Old, © 


ith H{a,a,} = A, 16,,. The functions 
re, Rezy, Rye and Ry, in (9) are the elements 
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of the correlation matrix of {a(t)} and 
{y(t)}. Thus, the expansion of {z(t)} and 
{y(t)} in the form of (5) and (6) reduces 
to solving a homogeneous form of the 
matrix integral equation (2). 

Next, assume that {2z(t)} and {y(t)} are 
jointly Gaussian processes. Consider a 
strip B, of width 2h centering on a curve 
u(t), 0 < t < T, in the (z, t) plane, and 
let B, be a strip of width 2h’ centering on 
a curve v(t), 0 < t < T, in the (y, t) plane. 
Similarly, let B.° and B,°® be strips of 
widths 2h and 2h’ centering on the ¢ axis 
in the (a, t) and (y, t) planes, respectively. 
Then the generalized joint-probability- 
density functional for the processes {z(t)} 
and {y(t)} over the interval [0, 7] is given 
by* 


Pirrt) ecb, 


and 
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which implies that 
T 
Q0) [Rat — aYradlr, &) dr 
a N sc DEAE, é). (15) 
Now, since (3) holds for 0 < ¢ < T, 
(15) is valid for 0 < ¢ < T, and hence 


Q(p) ik Relt — 1)tec(r, &) dr 


and Ner(p)re(t, £) will differ by, at most, 
delta functions at the end points. Conse- 
quently, operating on both sides of (3) with 


y(t)e B, for gE 


Pou, v) = dim 


nanrovo Pr {a(t)e B2 and y(t)eB, for 


li 


where z(7) is a vector with components 
u(r) and o(7r), and z’(é) is the transpose 
of z(). Joint density functionals of this 
form can be employed effectively in prob- 
lems involving Gaussian signals over 
finite intervals of time. Note that to find 
Pr(u, v) one has to solve the integral 
equation (3) for R“(r, £). 

We now proceed to outline a method of 
solution of this equation for the case where 
the spectral-density matrix G(w) is rational 
in w. Without loss is generality, G(w) 
can be written as 


py contece 
GW) = a5 | | , (12) 
20) | IN, (Gia) Ny des) 


where Q(jw), Naz(jw), **: , Nyy(jw) are 
polynomials in jw. Let the elements of 
R-(t, +) be denoted by fzz(t, 7), Tzy(t, 7), 
Tya(t, 7), Tyy(t, 7). Then, upon operating on 
both sides of (3) with the differential 
operator Q(@); p = d/dt, 0) S47 S 7, 
we note that a typical term such as 


r 
[ R(t — 7)fea(7, &) dr 
0 


is transformed into 


[ Q@RAG — Dyrulr, 8 ar, (18) 


and, since Nzz(jw)/Q(jw) is the Fourier 
transform of Rzz(7), 


Q(p)Rax(t — 7) 


= N.Ap) ¢ — 7), (14) 


4 This definition of the probability-density func- 
tional Pp (u, v) is based on an analogous interpretation 
of Preston’s result for the case of a single Gaussian 
process suggested by George Turin. Pr(u, v) can 
also be defined as a Radon-Nikodym derivative. 
For related results see E. Parzen, ‘‘Statistical in- 
ference on time series by Hilbert space methods, 
1,” Appl. Math. and Stat. Lab., Stanford University, 
Stanford, Calif., Tech. Rept. 23; January, 1959. 


ep {2 [" nor, 920 & ast, 


Wes 
oe (10) 


IAA 


T} 


(11) 


Q(p) will yield a system of differential 
equations of the form 


N(p)R“(é, €) 
= Q(p)I 6(¢ — &) + AG, 8), 


in which N(p) is a matrix with elements 
Nux(p); es) Nylp); and A(t, é) is a 
matrix with elements 


Ces Da, UG 


m 


(16) 


ihe, 6 (een eeg) 
where the D;;™ and #;;™ are unde- 
termined coefficients and m < q — l, q 
being the order of Q(p). 


A general solution of (16) may be written 
as 


R(t, £) = N-“(p){Q@)I ot — £) 
+ At, 8} + AG, 8), 


where A(é, £) is a matrix with elements 


A(t, &) = DU AD eA), 


(18) 


(19) 


in which the A;; are constants and the 
ga(t) are linearly-independent solutions of 
the homogeneous system N(p)d = 0. 
Since A’(t, £) contains delta functions of 
order at most g — 1, the term N“\(p)A‘(t, &) 
will contain delta functions of order at 
most g — n — 1, where n is the degree of 
the lowest term in N(p). Consequently, 
we have 


R(t, £) = Q@)N(p)I a(t — &) 
+ A(é, &) + AG, é), 


where A(t, £) is a delta-function matrix 


(20) 
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with elements of the form 
a-—n-1 
A,;;(t, &) = ae [Ber ote 
m=0 
-++ Ce Seu: ay iy (21) 


in which the B;;™ and C;;%™ are unde- 
termined coefficients. 

As in the case of the one-dimensional 
integral equation,® the B;; and C;;%”™ 
may be determined by substituting (21) 
into (3) and treating the resulting equations 
as identities. To illustrate, consider a simple 


example in which {2(t)} and {y(¢)} are 
stationary processes with the  spectral- 
density matrix 
GQ) =a 
a—p 
a? — p a-—p 


| (22) 
eee a+1l—p 


5K. 8. Miller and L. A. Zadeh, “Solution of an 
integral equation oceurring in the theories of pre- 
diction and detection,’ IRE Trans. on INFORMATION 
Tueory, vol. IT-2, pp. 72-75; June, 1956. See also, 
C. L. Dolph and M. A. Woodbury, ‘ ‘On the relation 
between Green’s functions and covariances of certain 
stochastic processes and its application to unbiased 
linear prediction,’”’ Trans. Am. Math. Soc., vol. 72, 
pp. 519-550, May, 1952; and V. S. Pugachev, 
EM tethod of ‘solving the basic integral equation of 
the statistical theory of optimum systems in closed 
form,” Prik. Mat. i Meh., vol. 23, pp. 3-14; January, 
1959 (in Russian). 


Here det N(p) = (a? — p?)? and solutions of 
the homogeneous equation are e*2! and 
te+at, Thus, a typical term such as rzz(t, & 
reads 


—a|t—7| 


rat, ) = b-D +5- 


eA Ane —at a Aye —at 
AES Ae oo a Ae 
HE By, 6(t) AF Cu é(t i Lia. (23) 


On substituting rz:(t, &), Sera #3) 
into (3) and treating the resulting equation 
as an identity, one finds the following 
explicit expressions for the elements of the 
inverse kernel R“(t, £): 


realty 8) = ab — 8) + gee 
a so ete 
— na sinh at sinh aé (24) 
tee ty E) er ee 
i “asin et (25) 


mlb) = b- | -— Gee", 


It should be noted that the determination 


processes can be carried out in exactly 
the same manner, 
undetermined coefficients in 
increases rapidly with n. One exception is 
the special case where N(p) is a constant 
matrix. For processes of this type, 
given simply by R71(t, &) 


Ty(t, &) = —eY PIE — 2b) 


+ — e” sinh ag (26) 


a 


of R“(¢, &) for higher-dimension vector 
but the number of 
Ri, @ 


R14, €)is 
= Qp)at — €). 


J. B. Tuomas 

Dept. of Elec. Engrg. 
Princeton University 
Princeton, N. J 


L. A. ZADEH 

Dept. of Elec. Engrg. 
University of California 
Berkeley, Calif. 


a <i 


ontributors 


hillip Bello (S ’52—A ’55), for bi- 
aphy, please see page 55 of the January, 
1, issue of these TRANSACTIONS. 


OU 


ack Capon (S ’54—M ’56) was born in 
w York, N. Y., on April 28, 1932. He 
eived the B.E.E. degree from the 
llege of the City of New York in 1953, 
> M.S.E.E. degree from the Massachu- 
ts Institute of Technology, Cambridge, 
ass., In 1955, and the Ph.D. degree in 
etrical engineering from Columbia Uni- 
sty, New York, N. Y., in 1959. 

e€ was a research assistant at the 
search Laboratory of Electronics of 
.LT. from 1953 to 1955, and an instructor 
the Electrical Engineering Department 

Columbia University from 1955 to 
59. At present he is working for the 
sderal Scientific Corporation, New York, 
. Y., where he is concerned with the 
tection and processing of signals in 
ise, and with problems in spectral 
calysis. 
Dr. Capon is a member of Tau Beta Pi, 
ta Kappa Nu, Sigma Xi, the Institute of 
athematical Statistics, the Acoustical 
ciety of America, and the American 
ssociation for the Advancement of Science. 


2, 
Od 


Janis Galejs (A ’52—M ’57) was born 
Riga, Latvia, on July 21, 1923. He 
ceived the Engineering Diploma in 
ectrical engineering from the Technical 
niversity, Brunswick, Germany, in 1950, 
id the M.S. and Ph.D. degrees in electrical 
gineering from the Illinois Institute of 
echnclogy, Chicago, in 1953 and 1957, 
spectively. 
While attending I.I.T., he worked for 
ie Cook Research Laboratory on fire 
nmtrol problems, radar, and communica- 
on systems. In 1957 he joined the Applied 
esearch Laboratory of Sylvania Electric 
roducts, Inc., Waltham, Mass., where he 
engaged in studies of radar systems and 
statistical analysis of radar and com- 
unication problems. More recently, he 
is been concerned with propagation in 
spersive media and in ionosphere. 
Dr. Galejs is a member of Sigma Xi and 
au Beta Pi. 


E, M. Glaser (S ’49—A ’50—M ’55) 
was born in New York, N. Y. on October 
17, 1927. He received the B.E.E. degree 
from The Cooper Union, New York, in 1949. 
He received the M.S.E. degree in 1954, and 
the D. King. degree in 1960, both from The 
Johns Hopkins University, Baltimore, Md. 

From 1950 to 1952, he was associated 
with the Glenn L. Martin Company of 
Baltimore as an electromechanical engineer. 
From 1952 to 1960, he was a member of 
the staff of the Radiation Laboratory of 
The Johus Hopkins University. There he 
worked primarily in the field of communica- 
tion theory. Since June of 1960 he has 
been a Fellow in the Department of Physi- 
ology of The Johns Hopkins School of 
Medicine, where he is engaged in the appli- 
cation of communication theory to problems 
in the field of neurophysiology. 


- 


OG 


+, 


Marcel J, Golay (SM ’51—F ’60) was 
born in Neuchatel, Switzerland, on May 
3, 1902. He attended the Gymnase Scienti- 
fique of Neuchatel where he received the 
B.S. degree in 1920, and the Federal Insti- 
tute of Technology in Zurich, where he 
received the Licentiate in Electrical Engi- 
neering in 1924. He attended the University 
of Chicago, Chicago, Il., where he obtained 
the Ph.D. degree in physics in 1931. 

From 1924 until 1928, he was at the 
Bell Telephone Laboratories. After a short 
association with the Automatic Electric 
Company, Chicago, Ill., he entered the 
civil service in 1931, and was a member of 
the Signal Corps Engineering Laboratories 
at Fort Monmouth, N. J., until 1955. He is 
now serving as censultant to the Philco 
Corporation, Philadelphia, Pa., and to 
the Perkin-Elmer Corporation, Norwalk, 
Conn. 

Dr. Golay is a member of the American 
Physical Society, the Optical Society of 
America, the American Rocket Society, 
and the Society for Applied Spectroscopy. 
He is the recipient cf the 1951 IRE Harry 
Diamond Award and of the 1961 ACS 
Sargeant Award. 


Od 


William F. Higgins (S “49—A 750 — 
M ’55—SM ’60) was born on September 2, 
1920 in Boston, Mass. He received the B.S. 
degree in 1950, and the M.S. degree in 
1953, both in electrical engineering from 
the University of Massachusetts, Am- 
herst, Mass. During World War II, he 
served as a communication officer in the 
Air Force. 


1 IRE TRANSACTIONS ON INFORMATION THEORY 121 


From 1950-52 he was an engineer with 
the Vitro Corporation of America, Silver 
Spring, Md. He was instructor in electrical 
engineering from 1951 to 1953 at the Univer- 
sity of Massachusetts, and from 1953 to 
1955 at Brown University, Providence, R. L., 
where he was a part-time graduate student. 
In 1955 he joined the Applied Research 
Laboratory of Sylvania, Waltham, Mass., 
where he was an engineering specialist. In 
1960 he joined Aeronutronic, a Division of 
the Ford Motor Company, Newport Beach, 
Calif., and is presently working on the 
sensor and communication problems of 
space surveillance. In 1961 he became a 
staff member of Lincoln Laboratory, 
Massachusetts Institute of Technology, 
Lexington, Mass. 

Mr. Higgins is a member of Sigma Xi 
and Tau Beta Pi. 


7 
Og 


David Middleton (S ’42—A ’44—SM 
’53—F 759), for biography, please see 
page 413 of the June, 1960, issue of these 
TRANSACTIONS. 


2%, 
Ia 


Joseph S. Wholey was born in Cranston, 
R. I., on February 6, 1935. He received the 
B.A. degree in mathematics from Catholic 
University, Washington, D. C., in 1956, 
and the M.A. degree in mathematics from 
Harvard University, Cambridge, Mass., in 
1958. He is a candidate for the Ph.D 
degree in philosophy at Harvard University 
and is currently completing his thesis in 
mathematic logic on the decidability of 
axiomatic theories. 

In 1955 and 1956 he was employed in the 
analyzing missile test data at the Applied 
Physics Laboratory of Johns Hopkins 
University, Silver Spring, Md. Since 1957 
he has combined work at the Applied 
Science Division of Melpar, Inc., Water- 
town, Mass., with teaching at the Newton 
College of the Sacred Heart, Newton, 
Mass., where he is an assistant professor of 
mathematics. His work at Melpar includes 
the application of information theory and 
approximation methods to pictorial data 
compression by computers. He has also 
studied statistical methods of solving 
electromagnetic reconnaissance problems. 

Mr. Wholey is a member of Phi Beta 
Kappa and Sigma Xi. 


122 


Abstracts 


IRE TRANSACTIONS ON INFORMATION THEORY 


Apri 


This Section of the issue is devoted to abstracts of material which may be of interest to faGuela members. Sources are 
Government, Industrial and University reports, and books and journals published outside of the United States. Readers 
familiar with material of this nature which is suitable for abstracting are requested to communicate the pertinent informa- 


tion to one of the Editors or Correspondents listed below. 


Editors 


R. A. Epstein 
Seneca 29, 42, 12 
Barcelona, Spain 


G. L. Turin 

Dept. of Electrical Engineering 
University of California 
Berkeley 4, Calif. 


Correspondents 


D. A. Bell 
University of Birmingham 
Birmingham, England 


S. V. C. Aiya 
Indian Institute of Science 
Bangalore 12, India 


H. Mine 

Defense Academy 
Obaradai, Yokosuka 
Japan 


G. Francini 

sts 12a be 

Viale di Trastavere, 189 
Rome, Italy 


Zeros of a Random Stationary Signal—H. Debart (in French). 
(Cables & Transmission, vol. 14, pp. 191-199; July, 1960.) 


Consider a random stationary signal Y(t); then if x(t) is set 
equal to 1 for Y(t) > 0 and equal to —1 for Y(t) < 0, the study 
of the zeros of Y(t) is equivalent to the study of the transitions of 
x(t). Several known results are stated, and subsequently some 
characteristics of the distribution of the zeros of x(t) are obtained 
by expanding x(t) in the Loéve-Karhunen expansion. The results are 
approximate, but relatively easy for numerical computations. 


A Systematic Code for Non-Independent Errors—T. Kasami 
(in Japanese). J. Information Processing Soc. Japan, vol. 1, pp. 
132-137; November 3, 1960.) 


A class of systematic codes is described; these codes are designed 
to correct any one of the following code errors: single error, double- 
adjacent error, three-binit-wide double error, and triple-adjacent 
error. It is shown that the codes considered are highly efficient. 
A pair of linear feedback shift registers may be used for the purpose 
of constructing this class of codes. 

Let the “code-word length” and the ‘number of check digits’ 
be denoted by n and m, respectively. Then for an even number 
m, the “complete” codes are given whose parity-check matrices 
are constructed by using two sequences of the following type: 
a maximum-length sequence of period 3 and a suitable maximum- 
length sequence of period 2”-2 — 1. These codes are equivalent 
to those obtained by Melas. The condition is then considered by 
which the maximum-length sequence of period 27-2 — 1 should be 
selected and, as an example, a simple decoding procedure is also 
presented, 

For an odd number m, a method is proposed which permits the 
systematic construction of codes. For example, this method yields 
a (27, 20) code and a (121, 112) code, both of which are more effi- 
cient than the respective Reiger code and are as easily realized by 
electronic devices. 


Phonetic Recognition and its Measurement—J. ©. Lafon (in 
French.) (Ann. des T élécommunications, vol. 15, pp. 27-37; January— 
February, 1960.) 


A “phoneme”’ is tentatively defined as being the smallest phonetic 
unit which permits the distinction of two words of different meaning, 
differentiated just by that acoustic unit. Phonetic integration 
represents the understanding by sensory means of acoustic symbols 
called phonemes and the possibility of distinguishing the criteria nec- 
essary for their individualization. First, understanding is studied— 
that is, the development of the phonetic complex and its acquisition 
by a child; subsequently, the methods of measurement are studied. 
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Different perturbations are evoked in terms of their peripheral ot 
central localization. Finally, the neurological and phonetic aspects 
aré considered and the practical applications of their measurement™ 


On a New Theory of the Limitation of Signal Spectra—J. Oswald 
(in French). (Cables & Transmission, vol. 14, pp. 249-261; October, 
1960.) | 


The object of this study is a critical examination of the present 
theory of the limitation of signal spectra. The well-known diffi- 
culties which arise from the strict limitation of spectra, in particular 
the simultaneous localization of a signal in time and in a frequency 
interval, come from an erroneous interpretation concerning the 
operation of spectral limitation. The solution presented here cireum- 
scribes all these difficulties; it permits the establishment of a general 
and coherent theory of the limitation of spectrum and, subsequently, 
of determining the signal transformation by ordinary operators 
(especially those that are associated with linear networks) without 
specifying them. It is therefore possible to consider ideal operations 
of filtering, integration, differentiation, etc., the results of which are 
in perfect agreement with those of the rigorous theory applied to 
particular instances (composition products), or even with the ele- 
mentary conclusions of common sense. 

The essential idea which is the basis of this work is the substitution 
of a distribution for the continuous functions generally utilized to 
represent signals and operators; it can be concluded that, at the cost 
of an amplitude quantization, all continuous linear operators can be 
replaced by arithmetic or digitized operators. 


A Method of Finding the Original Message as Accurately as Desired 
From a Finite Number of Observations After a Rectangular Band- 
pass Filter—H. Wolter (in German). (Arch. Elekt. Ubertragung, 
vol. 13, pp. 8938-404; 1959.) 


If a finite message is observed with a device providing an ex- 
tremely sharp cutoff of the frequency band, and a calculation of the 
original message from it is demanded with an error <, a measuring 
error bound 6(e) > 0 always exists in such a way that the original 
message can be calculated with the required accuracy from a 
finite number of observations with errors <6. The proof uses a 
method of summation of divergent series due to Euler. It is essential 
that one know the duration of the original message. 


On the Limiting Behavior of Extremely Selective Communication 
Channels in Information Theory—H. Wolter (in German). Arch. 
Elekt. Ubertragung., vol. 13, pp. 171-174; 1959.) 


A Gaussian error function cannot be the frequency function of ar 
information channel. A sequence of filters can approximate the 
Gaussian behavior in the amplitude channel, but then the phas¢ 


1 Abstracts 


aracteristic diverges. Therefore the use of Gaussian pulseforms 
characteristics in information rate calculations is inadmissible. 


e Fundamental Theorems of Information Theory as a Conse- 
ence of Error Propagation in the Solution of Convolution Inte- 
Is—H. Wolter (in German). (Arch. Elekt. Ubertragung., vol. 
pp. 101-113; 1959.) 


iven a filter (channel), a random telegraph signal, and the 

ition of white noise, one asks for the optimum speed at which 

signal should be sent through the channel. If the length of a digit 

seconds, the capacity is calculated as C = 1/r = (a/2r)(N;/n;) 

is a constant of about 1, N, is the signal power, and n,; is the 
‘ise power per unit bandwidth). The criterion chosen is that at 
e optimum speed the mean square error due to noise and that 
ie to distortion are both half the mean square of the signal. (Thus 
pacity is not used herein in the sense of the coding theorem. ) 
re next question is: if the signal is quantized in m steps (instead 
2), what is then the best speed? Since the accuracy required 
es up by m?2, the capacity goes down by (2 In m)/(m?2/4)(2 In m is 
e gain per time unit due to m steps). 


n the Fundamental Theorem of Information Theory, Particularly 
plied to Optics—H. Wolter (in German). (Physica, no. 24, pp. 
7-475; 1958.) 


In optics there exists a theorem analogous to the Nyquist theorem. 
ecifically, it is impossible to know the angle a; from which photons 
tive with an accuracy better than A(sin az) = /Azg (Xd is the 
avelength and Az the aperture width). However, the author shows 
at by special means, e.g., the use of crossed Fresnel biprisms, 
gain of about 300 in angular accuracy can be reached. The limi- 
tion is then given by the number N of photons available 
X.Aa,/’ = d/VN- 

For the measurement of optical grids with insufficient aperature, 
ie introduction of a second grid nearly parallel to the first gives 
1ough information in the image to deduce the otherwise unavail- 
ple constants. 


n the Fundamental Theorems of Information Theory, Particularly 
pplied to Communications—H. Wolter (in German). (Arch. Elekt. 
Thertragung., vol. 12, pp. 335-345; 1958.) 


According to the Nyquist (Kupfmuller) criterion, resolution 
time and bandwidth are related by AtAv < 4. Shannon’s sampling 
veorem states that any function limited to the bandwidth W and 
me interval 7’ can be specified by giving 27W numbers. However, 
ymmunication with exactly limited bandwidth is impossible (the 
aley-Wiener criterion; a less exact proof is given herein). From 
»tical and communication examples, it is shown that where the 
yndwidth is not limited so exactly, the resolution can be made 
uch better than expected from the above relations by equalization 
ompensation filters). The only limitation is then effectuated by 
vise. 


The following papers appear in the Transactions of the First Prague 
onference on Information Theory, Statistical Decision Functions, 
1d Random Processes (held on November 28-30, 1956). These Trans- 
tions were published by the Publishing House of the Czechoslovak 
cademy of Sciences, Prague, Czechoslovakia, 1957. The affiliations 
‘the authors are given below; abstracts are given when available. 


he Entropy of Functions of Finite-State Markov Chains—D: 
lackwell (in English). (University of California, Berkeley, Calif.) 
It is shown that the entropy H of an ergodic process 
Ing -2 <n < ©} withstatesa =1,---, Asuchthaty, = S(rn) 
here {z,} is a stationary ergodic finite-state Markov process with 
atest = 1, --- , J and transition matrix M = || m(7, 7) || is given by 


H=-— il » r.(w) log ra(w) dQ(w), 


here r,is a function, defined on the set W of all w = (wi, «°° 
ich that 


I 
W; 2 0); Ds Wi = i Ta(W) 75 MS, 


7,79P(j)=a 


, Uz) 


w;,m(t, 4) 


1d Q is the distribution of the conditional distribution of xo given 
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Yo. Y-1, ‘°° . An integral equation is obtained for Q, and a method 
is given for showing, under rather strong hypotheses, that the 
solution of this integral equation is unique. An example in which Q 
is singular is given. 


On Some Soviet Work in Information Theory—B. V. Gnedenko 
(in Russian). (Math. Inst., Ukrainian Acad. Sci., Kiev, USSR.) 


A Display of Information Theory Problems Concerning Telephone 
Transmission—H. Hansson (in English). (Tel. AB L. M. Ericsson, 
Sweden.) 


The Selectivity of Parametric Tests—C. Rajski (in English). (Inst. 
Math., Polish Acad. Sci., Warsaw, Poland.) 


Let Q be the unknown value of a parameter of a general population 
whose distribution function is known; let n be the sample size and 
Q— the critical region; The possible results of testing the hypothesis 
stating that the actual value of the parameter is Q is described, 
in a statistical sense, by the power function of the test denoted here 
by M(Q, n, G). The power function may be “better” or ‘worse,’ 
the judgement being usually based on two values taken by the 
power function for the values of Q assumed in the null hypothesis 
(Qo) and in the alternative hypothesis (Q:). As usual, we write 


M(Q, nN, Qo) “, 
M(Q, nN, Q,) ett Oia er 


Any monotonically increasing function of x and 8, say r(x, 8), can 
serve as a measure of “goodness” of the power function of the test, 
the smaller values of r(x, 6) indicating that the test is a “better’’ 
one. 

This method is rather unsatisfactory, as the evaluation is based on 
two points only of the power function. A more elaborate qualification 
can be obtained by treating the unknown parameter as a random 
variable. Its entropy denoted here by L(Q, n) and, defined by the 
formula 


oM oM 
aQ log a0 dQ, 


seems to be a more suitable measure of “‘goodness’’ of the test as 
based on the shape of the power function as a whole. 


L(G, n) = — 


The Bayes Rule and Entropy—C. Rajski (in English). (See above 
for affiliation.) 


By the Bayes rule we mean the assumption that in the lack of 
the empirical knowledge concerning the @ priori distribution of the 
unknown parameter lying in the finite range, this distribution should 
be taken as a uniform one. The severe criticism of this assumption is 
widely known. Here the attempt will be made to support the Bayes 
rule and to present the extension of this rule to the cases of semi- 
infinite and infinite ranges. 


Remarks on Linear Prediction by Means of a Learning Filter— 
L. Prouza, (in German). (Res. Inst., for Radio Engrg., Pardubice, 
Czechoslovakia.) 


Continuous Random Decision Processes Controlled by Experience— 
M. Driml and A. Spaéek (in English). (Inst. of Radio Engrg. and 
Electronics, Czechoslovak Acad. Sci., Prague, Czechoslovakia.) 


This paper contains a generalization of the theory of experience 
to the ‘‘continuous”’ parameter case. Roughly speaking, there is 
given a generalized random process depending on the continuous 
time parameter and the “‘value’”’ of which at each time instant is a 
statistical decision problem. Under proper assumptions it is possible 
to choose a decision process depending on the time parameter as 
well, such that the average risk defined conveniently converges to 
the least possible constant or to a limit which lies in a given neighbor- 
hood of this minimum. The construction of this time-dependent 
decision process is controlled automatically by the experience ob- 
tained by storing in a proper way the past values of the process. 


Generalized Random Variables—O. Hans (in English). (Inst. of 
Radio Engrg. and Electronics, Czechoslovak Acad. Sci., Prague, 
Czechoslovakia.) 


Rankom Fixed-Point Theorems—O. Han& (in English). (See above 
for affiliation.) 
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Inverse and Adjoint Transforms of Linear Bounded Random 


Transforms—O. Han$ (in English). (See above for affiliation.) 


The inverse and adjoint transforms of linear transforms mapping 
some part of a Banach space into another Banach space are useful 
tools for studying various problems of functional analysis. It seems 
reasonable to deal with similar questions for linear random trans- 
forms. In this paper some measurability problems for inverse and 
adjoint transforms of linear bounded random transforms are solved. 


Almost-Sure Convergence Theorem for Random Schwartz Dis- 
tributions —O. Han (in Nnglish). (See above for affiliation). 


Note on Generalized Random Variables—J. Nedoma (in English). 
(Inst. of Radio Engrg. and Electronics, Czechoslovak Acad. Sci., 
Prague, Czechoslovakia. ) 


The Capacity of a Discrete Channel—J. Nedoma (in English). 
(See above for affiliation.) 

Research on the problem of the transmission of discrete mess- 
ages has so far proceeded in two principal directions. On the one 
hand, it has been concerned with the question of the extent to which 
a text with certain statistical properties could be abbreviated by 
coding. The other problem considered by some authors is the 
question of minimized noise in the transmission of messages. For 
this purpose it was necessary to introduce a suitable mathematical 
model and also certain quantitative characteristics describing the 
communication link in terms of those properties that are essential 
in the transmission of messages. 

The problem of a suitable mathematical model, e.g., for a trans- 
mission channel, has apparently not yet been finally solved, even 
in the case of a discrete message. This is borne out by the fact that 
in four significant papers on this subject, namely the papers by 
Shannon, McMillan, Feinstein and Khintchine, the concept of a 
channel is defined in different ways. The kernel of these papers is 
the question of the validity of the Fundamental Shannon Theorem, 
which McMillan formulates in the following way. 

Let the given channel have capacity C and the given source have 
rate H. If H < C, then given any « > O, there exists an integer 
n(e) and a transducer (depending on ¢) such that when n(e) con- 
secutive received letters are known, the corresponding n transmitted 
letters can be identified correctly with probability at least 1 — . 
If H > C no such transducer exists. McMillan draws attention to 
the fact that the proof of this theorem requires the channel to be 
in some sense “continuous.” 

The present paper does not define the concept of a channel as 
broadly as is done in MeMillan’s paper, on which the present paper 
is mainly based. Nevertheless, though our restriction entails a 
definite continuity, it turns out that even in this case the above- 
mentioned Shannon Theorem may not be valid. The results of 
this paper will be discussed in Chapter V. 

The paper is subdivided into five chapters, the first two of which 
are mainly concerned with the formulation of the required concepts 
and proofs of some of their properties. The main subject of Chapter 
IIT is the proof of Shannon’s Theorem for channel capacity defined 
with respect to the probability of error or to the average frequency 
of error respectively and also the proof of the equality of both these 
capacities. Chapter IV investigates the relation between the prob- 
ability-of-error capacity and Shannon’s channel capacity. 

The notation used in the paper follows for the most part Me- 
Millan’s notation. The majority of basic theorems have an asymp- 
totic character and the conditions imposed on the basic concepts 
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enable us to apply the analysis of the infinite-dimensional case also to 
the finite-dimensional case (for “sufficiently large n’’). Therefore, 
this paper introduces for a number of concepts both “infinite. 
dimensional” and “‘finite-dimensional’’ versions (e.g., sequences 
and n-dimensional vectors, integral and summation forms of certain 
characteristics, etc.). The corresponding version is then used ¢ 
required. 


Generalized Concepts of Uncertainty, Entropy and Information 
from the Point of View of the Theory of Martingales—A. Pérez 
(in French). (Inst. of Radio Engrg. and Electronics, Czechoslovak 
Acad. Sci., Prague, Czechcslovakia.) 


On the Theory of Information in the Case of an Abstract Alphabet 
A. Pérez (in French). (See above for affiliation.) 


On the Convergence of Uncertainties, Entropies and Sampled 
Information to their True Values—A. Pérez (in French). (See 
above for affiliation.) 


An Elementary Experience Problem—A. Spacek (in French). (See 
above for affiliation.) 


Extensions of Random Transformations—A. Spacek (in French), 
(See above for affiliation.) 


Some Theorems on Random Schwartz Distributions—M. Ullrich 
(in English). (Inst. of Radio Engrg. and Electronics, Czechoslovak 
Acad. Sci., Prague, Czechosolovakia. ) 


A Theorem on Extremes of Entropy—L. Votavovdé (in German) 
(Inst. of Radio Engrg. and Electronics, Czechoslovak Acad. Sci., 
Prague, Czechoslovakia.) 


Suppose that the largest probability value of a discrete random 
variable is fixed, but that some of the probabilities are unknown. 
The proof is given that maximum entropy occurs when the lacking: 
probabilities are assumed to be equal. Minimum entropy is found 
by setting as many as possible of the unknown probabilities equal 
to the largest known, by setting one probability equal to the comple-. 
ment with unity of the sum of all former probabilities, and equating, 
in consequence, the remaining probabilities to zero. | 


Experience in Games of Strategy and in Statistical Decisions— 
K. Winkelbauer (in English). (Inst. of Radio Engrg. and Elec- 
tronics, Czechoslovak Acad. Sci., Prague, Czechoslovakia.) 


This paper is devoted to a group of problems called problems 
of the theory of experience. The concept of experience is described, 
and the motives which have led to the choice of the mathematical 
model for statistical decision used herein are stated. It is shown 
that the mathematical model of a communication system is identical 
with that of statistical decision problems. The performance of the 
system under assumed knowledge of the a priori probability dis- 
tribution of transmitted signs is defined and called the average 
risk. Its lower bound is called the Bayes risk. The statistical decision 
functions may be chosen in such a way that the average risk con- 
verges toward the Bayes risk. The same, however, is true even in 
the case when the a priori distribution is unknown at the receiver, 
provided that it is constant. One has to replace only the unknown 
probability distributions obtained in a prescribed manner from the 
experience gained in preceding steps. 

In part, a somewhat different methodical approach to the basic 
concepts of the theory of games is taken and is developed in an 
expository manner. 


ook Reviews 


sting Statistical Hypotheses—H. L. Lehmann. (John Wiley and 
s, Inc., New York, N. Y.; 1959. 369 Pages. $11.00) 


There are several areas in which the techniques of mathematical 
tistics can be useful to a radio or electronics engineer, e.g., quality 
trol in component production, design of experiments and inter- 
tation of results in propagation-research, and design of radio 
radar receivers to work effectively under adverse conditions of 
se, clutter, multipath, etc. Presumably, however, it is the last- 
ntioned application which has really stimulated an interest in 
theory of statistical inference on the part of radio engineers 
d which, indeed, prompts a review of a book of this kind in this 
irnal. It seems fair, then, to observe at the outset that, because 
its coverage, Professor Lehmann’s book has limited usefulness 
the solution of current problems in statistical decision theory 
ising in radio communications, radar, radio astronomy, and 
ied fields. The book does not cover parameter estimation nor 
e kind of theory which arises in the application of statistical 
ference to stochastic processes; both of which are necessary in 
e class of problems referred to. The book does provide an excellent 
satment of one part of statistical decision theory (the small- 
mple theory of hypothesis testing) which would certainly be 
Ipful to a person who is developing a thorough grounding on 
nich to base his applied work. 

Chapter 1, entitled ‘““The General Decision Problem,” contains 
preliminary discussion of the formulation of a decision problem 
terms of sample space, parameter space and decision space. The 
neepts of loss and risk and optimum procedures are introduced, 
eluding Bayes and minimax procedures. The maximum-likelihood 
athod is discussed briefly, and the chapter closes with an informa- 
ye, non-measure-theoretic introduction to sufficient statistics. 
he reviewer feels that this chapter is the best introduction to 
odern statistics he has read and recommends it particularly to 
e nonstatistician who wants to get some general feeling for what 
odern statistics is about. The second chapter is a rather brief 
view of the appropriate parts of measure and probability theory, 
1d will probably provide rough going for one unfamiliar with 
easure-theoretic probability. 

With Chapter 3 the book gets to its central theme, as stated 
the title. The problem of testing a simple hypothesis against a 
nple alternative is introduced and the fundamental lemma of 


, 


61 IRE TRANSACTIONS ON INFORMATION THEORY 125 


Neyman and Pearson, leading to the likelihood-ratio test, is care- 
fully stated and proved. An immediate extension is made to the 
particular class of problems, in which a compound hypothesis is 
tested against a compound alternative, for which the family. of 
probability densities possesses the property of monotone likelihood 
ratio. In this case, likelihood ratio tests are UMP (uniformly most 
powerful). Some additional topics in Chapter 3 are: an extension 
of the Neyman-Pearson lemma to more side conditions, a discussion 
of confidence bounds, and a proof of the optimality of the sequential 
probability ratio test. 

The central difficulty in the theory of hypothesis testing and 
the thing that makes the subject nontrivial is, of course, the fact 
that in general, with compound hypotheses and alternatives, there 
exists no UMP test. The situation the statistician has faced has 
been to devise consistent, convincing test procedures to work in 
problems for which by the simple power criterion no best test 
exists and, indeed, where by the same criterion two tests often can 
not even be compared. What has been done has been to impose 
reasonable restrictions on the class of tests allowed and then to 
search for UMP tests within these restricted classes. The usual 
restrictions are that the test be unbiased, satisfy a similarily con- 
dition, or be invariant under some group of transformations. In 
this book a thorough treatment of unbiased and similar tests is 
given in Chapters 4 and 5 and of invariant tests in Chapter 6. 
Chapter 7 is a long chapter on linear hypothesis testing (of which 
linear regression is a special case). Chapter 8 develops some theory 
using the minimax principle, which provides another and potentially 
quite general way of getting around the difficulty of no UMP test. 

The book has many examples worked out in the text, and an 
extensive list of problems for the reader. The examples include 
most of the standard testing problems involving Gaussian distri- 
butions and the well-known derived distributions, such as the 
y*-distribution or Student’s ¢-distribution; and a worker in communi- 
cations theory might find these immediately useful. There are 
also nonparametric examples. Each chapter has a fairly lengthy 
bibliography. 


WiuuraMm L. Roor 
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Lexington, Mass. 
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